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BACKGROUND 



The Ohio Career DovelQpment Program 

The present program emerged over a number of years ^ changing steadily 
from a set of eeparate projects at the beginning into the integrated program 
of today* The transition from separate pro j acts into an intagrated program 
is reviewed briefly below, 

The^ Start of Caraer Education in Ohio 

Career education began in Ohio in the lata 1960 -s when tha State 
Department of Education through the Division of Vocational Education 
funded local school districts to operate individual career education 
projects designed to serve selected grade ranges. One school districts 
for axampla, decided to start by operating a career education project 
for students in grades a project called the World of Work* A second 

district began ^th a project for junior high school students in grades 
7-8 s a project called Career Orientation. Some districts began high 
school pro J acts. 

Designating the Ohio Caraer Development Program for Grades K-^IO 

In 1971, the Division decided to relate and extend all local projects 
so as to provide a continuous career education experience for students in 
grades K-IO in participating school districts. To accomplish that, the 
Division davalopad a set of State Curriculum Guides and asked all funded 
diatricts to use them. 

The comprehensive Career Development Program which resulted was first 
Implemented in 1972-73. It was comprised of the following sepnents, each 
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of which bacama an integral part of the program: Career Motivation, 
ofiginally called World of Work, for grades K-^S; Career Orientation for 
grades 7-8 i and Career Exploration for grades 9-10* 

Number of Sch ool Dist ricts Participating * In 1972--73s there were 20 
districts participating in the Program; by 1973-74 ^ 24 districts; by 
1974-=75p 30 districts; and in 1975-76 » 32 districts. 

Part D P^qj^ect Sltes > Among the 32 districts are three supported undar 
the Division's VEA Part D grant from USOE* The three cities are^ 

1, The Cincinnati City School System which includes one high school 
and its ten feeder schools and involves 8s297^students. 

2*/^ The Cleveland City School System which includes one high school 
and its 17 feeder schools and Involves 12 j218*students , 

3, The Springf laid City School System which includes one high school 
and its 20 feeder schools and Involves 9,432^students* 

Evaluating the Ohio Career Development Program 

The Program has been under intensive evaluation for four years. 
During that time, five major evaluations have been conducted by staff 
from Policy Studies in Education (PSE) : 1) the 1972 observation/ evalua*^ 
tlon; 2) the 1973 development and administration of curriculum=^based tests; 
3) the 1973^74 evaluation/observation; 4) the .1974-75 development and 
administration of fiald-based tests; and 5) the 19?5r^76 three-site 
evaluation for career developmant projects. 

This section summarizes the first four evaluations. The following 
sections describe the 1975-76 evaluation In greater detail. 



^Information on the program sites was supplied by the Division in 
September of 1975, 
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The 1972 Observatlon/E^'aluation 

In 1972-73* with twenty districts participating » staff from PSE 
were askad by the Division of Vocational Flucation to conduct site visits 
and interviews in all twenty districts in order to answer the following 
questions : 

1, Is career education taking place in the classrooms? 

2. Is an average allotment of $25,00 per student enough 
money to implement career education In the twenty 
participating districts? 

3* Is an average allotment of §25.00 per student enough 
money to spread career education throughout the State 
of Ohio? 

4, Should the career development program continue to be 
administered by the Division of Vocational Education? 

' Career Education Appeared To^ Be Successful > The report j An Evalua= 

tlon of the Ohio Career Development Pro gram ^ was submitted in February , 

1973* Summarised answers to the four questions , which were elaborated 

in the report, are as follows i 

Question li Is cbt e e r education t akin g pi ace in t h e c 1 a s j^r o om ? 

"In summary 3 career education in Ohio is beginning to take place in 

classrooms* especially In grades K^S, but in all grades it appears chiefly 

as additional activities rather than as fully integrated parts of existing 

curricula . " 

Question 2i Is an average allotment of $25.00 per student 
QfiPMgh _money to implement career education in 
the twenty participating districts ? 

"The average allocation of $25,00 per child is enough money to 

implement the Career Development Program in the twenty participating 

school districts''-' implemGnt it to the degree indicated in the answer to 

Question 1 above." 
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Question 3' Is an average allotment of $25,00 per student 

_<iti_0M8h JflOJ^gy to spread career educati-on through^ 
out the State of Qhlo ? 

"Generally, It cas be said that since $25.00 per child is enough 

to implement a Career Development Program in twenty districts ^ the same 

allotment could suffice for other districts throughoi t the state which 

have characteristics in conmon with the present twenty*" 

- Question 4 : Should the Career Development Program continue 

to be a_dmlnistergd by the Division of Vocational 

Education? 

» - — -- - ■ - — — 

"Particularly during the early years of the Career Development Program 
and perhaps for years to come, career development can find no better admln-^ 
Istrative home within the Ohio Department of Education than it has found 
in the Division of Vocational Education*" 

The report also contained a series of reconmiendatioM for strenthen- 
Ing and improving the program. Some reconmendations specifically related to 
the four questions; others reflected additional observations as a natural 
by--product of the visits and interviews. 

The 1973 Development and Administration of Curricij-um^Based Tests 

In February, 1973, the Division asked PSE project staff t^ conduct 
an evaluation of the Career Development Program through testing students 
in four of the twenty school districts- • 

The four sites chosen by the .Division for that evaluation were the 
four required to have an external evaluation as a condition of Federal 
funding I Ohio's one VEA Part C site and its three VEA Part D sites. 
The four sites constituted a reasonably representative cross=sectlon of 
the kinds of schools to be found in most of the twenty school districts 
then taking part in the program. Thus the Division anticipated that by 
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using the Part C and Part D sites as the locations for evaluating student 
learning J whatever It learned could be applied to improving the program 
in most of the other school districts. 

^ avaluation plan was proposed with two major objectives i 

1. To develop and pilot test a sequential battery of 
cognitive and affective instrumenta for grades 3,^ 
6, 8, and 10 based on the Career Development Program 
State Curriculum Guides issued for grades grades 
7-^8, and grades 9-10. The tests would be designed 

to match the terminal points of the major program 
segments (grades K^3 ^ 4=6, and 9-10). 

2. To administer the final instruments to a represen-- 
tative sample of program and non^program students 
in the four Part C and Part D sites participating 
in the Career Development Program in order to eval-- 
uate its impact on student learning. ^ 

The instruments themselves would become measuring devices for com^ 
paring Intended student learning to actual student learning, not only 
in the four Initial sites but in additional sites in the future. The 
information derived from the first administration of the instruments 
would be reported to the Division so that the state leaders could modify 
program practices in participating school districts if necessary in 
carrying out their coimnitment to a high quality Career Development Program* 

The tests were developed in the spring of 1973 and were administered 
in May, 1973 to students in grades 3. 6, 8^ and 10 in the one VEA Part C 
site and the thre-B VEA Part D sites. The report of the findings , Testlnfi 
thm Ohio Career Development Program s was submitted to the Division in 
August, 1973, 

No Major Differences Found Between Program and Non-program Students , 
Both groups scored well on the tests. There were only small differences 
in favor of program students on both the cognitive and affective tests 
in all grades-^-3, 6^ 8» and 10. The small differences were less than 
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what the PSE staff expected they would be; they were less than what the 
Divteion hoped they would be* We were not surprised that non-^prograni 
students could answer some questions, but we were surprised that program 
students could not answer even more questions which would have 
demonstrated extra learning attributable to their being in the program. 

The PSE staff examined the data thoroughly, looking for patterns 
that could explain why program students did not score higher than non- 
program students^ or for patterns that might suggest how the program could 
be improved, t^ile no clear-cut explanations or patterns emerged, a 
number of possible interpretations of the findings were offered in the 
final report. Below is a BuTm^vy of the Interpretations writteti at that 
time I 

Interpretation 1: No Career Education Is Taking Place . It is possible 
that career education has not yet been effectively implemented in program 
classrooms* If so, it would mean that no matter what care and expense 
were put into developing tests, they would show no differences between 
program and non ^program students. 

We are inclined to reject this conclusion based on the 1972-73 eval=^ 
nation of the program in local school districts , where local , oject leader'- 
ship activities were highly visible and where there was enough evidence of 
career education in the classrooms to make PSE observers believe that 
students were learning. 

Interpretation 2i Other School Curricula Teach Career Concepts , 
The content of the Career Development Program has much in coimnon with other 
school curricula. That is, the relationship between self and environment ^ 
ideas about the world of work, concepts of economics, skills in decision- 
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makings and other areas of concarn in career developMnt also appear in 
on% form or another in many other subject fields. Thus thW students in 
non-program classes have elaborate ppportunities to learn that contxTnt^ 
in the study of various subjects at various grade levels* 

tfnlle the overlap of career devglopment content with the content of 
other curricula does not fully explain why program students did not demons 
strate extra learning on the tests , it seams reasonaBle to believG that 
it he3.ps explain why non-program students did ao well* 

Interpretation 3i Non-School Sources Teach Career Concepts . There 
are many ways for students to learn career concepts outside of schools 
at home, at play, at camp, at churchy while reading, while watchirig tele- 
vision, with friends, with adults, and so on* This is especially true-^ 
for the important career concepts measured by the te^ts* Society does 
not leave those important concepts to chance; ^t transmits them to young 
people in many ways. Since students outside the Career Development Program 
are exposed to these strong non-school influences, they learn enough to 
score about as well on the teats as program students* 

While this interpretation does not account for the absence of any 
extra career learning by program students, it may explain why non-program 
students did well on the tests* 

Interpretatioii 4i Program Students Cannot Fully Demonstr ate Their 
Learning on the Tests * The tests reflect the^vrogram as specified In the 
State Curriculum Guidas for grades 7-8, and 9-10* But the tests 

may be a better fit to the State Guides than to what is actually happen^ 
Ing in local program classrooms* Perhaps the program students cannot 
fully demonstrate on these tests what they have been learning—and thus 
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they eannot demonstirate their superiarity to non-program students. That 
ISp perhaps the testa do not fully reflect all that is being taught and 
learned in the program classrooms. 

Given the fact tl^at local programs often vary significantly from 
state guidelines, this Interpretation seems reasonable * at least as a 
partial explanation of what is happen Jjig. 

The 1973-74 Observation/Evaluation 

Uncertain which of these four hypotheses was true, the Division 
asked PSE to observe the ongoing program once again in a small sample 
of sites. In the spring of 1974, PSE staff visited four program sites 
selected by the Division. At each site, the staff examined ^he project 
for Itss ' ' 

1. Quality of project staff leadership. 

2. Teacher use of Career Development frogram Ideas 
and materials. 

3. Student Interest and participation in Career 
Development Program activities. 

PSE staff observed classes, accompanied the teachers and students on 
field trips, participated in other career-related activities, and con- 
ducted Interviews with project staff, teachers, and students. 

Again Career Education Appeared To Be Successful . IThlle there 
ware some variations among the four sites, the PSE staff found thati 
1. Local leadership was generally effective. 



2. There was evidence of teacher use of program ideas 
and materials in the classrooms. The evidence was 
greatest at the elementary levels not as great at 
the junior high level, and weakest at the high school 
level. 



3, Student Interest and participation paralleled 
teacher interest and participation and accord-- 
ingly most evident at the elementary level, 
less evidint at the junior high level, and least 
evident at the senior high level. 

On the basis of these findings, PSE rejected Interpretation Ir-, It 

concluded that career education was taking place in the program class-= ' 

rooms. We had seen it in the fall of 1972; we had seen it again in the 

spring of 1974* 

the Evidence of the Observations yersus the Evidence of the Instruments 

Were we to believe our eyes or our Instruments? " Basfd on the new 
observational evidence that career education had indeed reached the 
classrooms, PSE believed that Interpretation 4 given earlier was probably 
correct. That is, students in the program were indeed learning more than 
other students but It was something that they could not fully demonstrate 
on the original tests written to match the State Curriculum Guides* (In- 
terpretations 2 and 3-^--school and non-school sources were teaching much 
career content to students outside the program— continued to seem quite 
reasonable as well.) - 

Field-Based Tests to Supplement Curriculum-Based Tests , PSE believed 
that the way to verify Interpretation 4 would be to develop field-based 
t«sts to match the students' actual learning rather than curriculum-based 
tegts to Biatch the students' Intended learning as called for in tha State 
Guides. Presumably, this could be done by going into the field and da-, 
vslopliig tests on-site— close to the classroom where the actual learning 
was taking place— rather than at an off-site location where the test 
developers would have nothing but descriptions of intended learning to , 
guide them. 
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PSE believed that tests developad in this fashion — in and around _ 
program elassroonirin the flald^-would provide the Division with avldenca 
of eareer learning by discriminating between program and non-prograin 
students and showing the superiority of those in the program. Accordingly, 
PSE suggested that the Division call for the use of a variety of on-slta 
test development methods in a representative eross^section of school dis- 
tricts as a means of creating cognitive and affective test-Items which would 
successfully measure the full extent of student learning in program class- 
rooms. Tiiose test items would then be compiled into paper and pencil tests 
which presumably would discriminate between program and non^program students 
in grades 3, 6* 8^ and 10. 

Retaining the Curriculum-Based Tests . As to the original curriculum^ 
based tests built to match the State Guides, PSE believed that they should 
be revised for future use by the Division. Properly designed ^ such tests 
could constitute a description— -more exactly, a sampling , of a description— 
of Intended student learning. They could be used for such Important pur- 
poses as these! 

The test Instruments themselves could serve: 

1, As an "ideal" standard for what students should learn, 

2. As a target toward which teachers could direct their 
efforts, 

3* As a criterion against which to compare the eventual 
content of the field-based tests. 

When administered in the future, the tests could produce data to servei 

1, As a measure of the discrepancy between intended 
learning and actual learning* 

2. As measure of progress from the baseline estabrished 
for program and non-program students when the tests 
were first administered In May, 1973. (Only the orl-- 
ginal, unrevised items remainins in the test could be 
used to measure progress, of course,) 
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Tha 1974-75 DevelopTOent and Administration of Field-Based Tests 

The Division conduetad a competitlva bidding procedure In tha late 

fall of 1974 to select a contractor to davelop and administer field-*baSGd 

teste. A contract was awarded to PSE in Dacamber, 1974 to carry out the 

worlT requested by the Division. 

n> The scop a of work entailed i 

, • ITEM TOITING In 2 sites ^ j 

m PILOT TESTING In 4 sites ^ including the two 

ITEM TOTTING Sites 
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• FINAL TESTING In 7 sites. Including the four 

PILOT TESTING sites 



Items ware written and pilot testad in Akron^ East Muskingiunj Mansfield^ 
and South-western City. Final tasts ware administered In those four sites 
^ plus the three VIA Part D sitesi Cincinnati, Cleveland^ and Sprlngfiald. 

Willa the two sites selected for item writing were not as fully ra- 
hx^- presantativa of the state program as three sites we had originally 

hoped to uses thay navarthaless had demographic variations similar 

$ . - ^ 

r- to those in the state as a whole , Moraoyer, both sites selected for item 

writing had high quality Car ear Development Programs and therefore were 
rich sourcas of ideas for test items. 

Tha best evidenca of whether tha final tests were sensitive to 
I'i program activities statewlde'^would coma from administering the final 

tests not only in the four sites ln*which Items had bean pilot tested 
^ but artd^ln Ohio's three VEA Part D sites, none of which were involved 

111 the creation of the tests. 

Procedures. PSE employed a variety of methods to write Items in 
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two sites. Each item was then put into a pilot trial in the two item- 
wlting aitea and in two additional sites. It was administered in the 
program classrooms for which it was written^ in other program classroonis, 
and in non-program classrooms* Those items which discriminated most 
strongly in favor of program students were compiled into a 60--it ^ final 
teat for each of the grades 3, 6, 8, and 10. Those tests were then admlji- 
laterad to program and non-^program stud puts in grades 3, 6 s 8, and 10 in 
seven cities i The four pilot testing sites and the three Part D sites* 
The procedures involved these steps i 



ITEM 
WRITING 



PILOT 
TESTING 



FINAL 
TESTING 



1. Preparing the two itCTi-writing sites for the impending 
on^s te activities, 

2. Conducting the on-site item writing. 

3* Polishing and refining the items written on-site. 

4. Selecting from the earlier curricuium=-based tests 

any supplementary items which matched local activities, 

5. Administering the items in the four pilot testing 
sites. 

6. Scoring and analyzing the items In the four pilot 
testing sites, 

7. Compiling the discriminating items into a pool for 
possible inclusion in the final tests. 

8. Compiling the non-discriminating items (plus any 
which discriminated against the program students) 
into a pool to send to the Division at the close , 
of the study, 

9. Selecting the most discriminating items for the 
final tests, 

10, Administering the final tests, 

11, Scoring and analyzing the final tests, 

12, Reporting the results. 
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S rield"Based Tests Revealed Career Education Learning . Results from 

the administration of final testa in seven sites yielded the following 
findings i 

1* Program students scored higher than non-program students 
in grades 3, 6, 8, and 10 on both cognitive and affective 
tests. 

2. The superiority of the program students was statistically 
highly significant on mpst tests* 

3. Program students showed their greatest Buperiority over 
non^program students in grade 3, next in grade 6, next 
in grade 8, and last in grade 10. 

4* Program students showed greater superiority on the 
aognitive tests than on the affective tests* 

5. The typical student=-both program and non-program" 
found the cognitive tests relatl^rely easyi although 
not as easy as the affective tests* 

6. ^ The typical student"bdth program and non--program---- 
found the affective tests even easier than the cognitive 
tests. 

7. The fact that the typical non--program student answered 
60-70 percent of the items correctly indicates that the 
content of the program is not unique to program classroom.s 
but Is being taught in non-program classrooms as well. 
While the program students are learning more of it, the 
non-program students are learning much of it. , 

8. Regardless of the fact that non-program students scored 
well, program students clearly scored even higher than 
non-program students at all grade levels on both cog- 
nitive and affective tests. 

The results throw light on the four interpretations hypothesiEed In 

1973 when the curriculum-based tests failed to show differences between 

program and non--progrM^ students (see pages 6"8) i ■ 

Interpretation 1: No Career Education Is Taking Place . This 
— * . interpretation can now be firmly rejected. 
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Xnteifpratatlon. 2l Other School Curricula Teach Career Concepts . 
This ^[nterpretat ion continues to seam quite reasonable* Some 
" of the test Items that non-program atudents answered correctly 

M^r: * appeared to require school-taught knowledge* 

= Interpretation 3t Non-School Sources Teach Career Co ncepts* 

|: >. This interpretation continues to seem especially reasonable. 

ttany of the questions that non-prograin students answered cor-^ 
y:';. " rectly required infomatlon they could have learned outside 

K*v of school* 



Interpretation 4i Program Students Cannot Fully Demonstrate 
5:: ' Their Learning on the Tests * This interpretation can now be 

fully accepted* It is clear that the curriculum-based 
p. testa did not let the program stud^ents demonstrate their 

5?v> superiority as revealed by the^T974 fleld-^based tests* 

S- Based upon these findings ^ the Ohio Department of Education Division 

of Vocational Education asked PEE. to continue to refine field-based test 
t. instruments and to use them In conducting a product evaluation of the three 

^ V*EA Part D sites of Cincinnati, Cleveland^ and Springfield, Because PSE-s 

past observation/evaluation efforts have also yielded Information useful 
"v to state and local career development staff * the Division also asked PSE 

to conduct site visits and report on program process in these three sites, 
: The remainder of this report describes these evaluation efforts and PSE^a 

overall conclusions and recoranendations. 
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INTRODUCTION 

-»»'= . 

The 1973-76 Overall Plan 

The completion of the 1975-'76 school year marked the ending of the 
VIA Part D grant to the Ohio Division of Vocational Education for a com*- 
preheneive career education program , K=10. In response, the Division 
issued a call for competitive proposals to evaluate the three Part D 
project sites* PSE submitted a competitive proposal to the Division* 
It described a plan for evaluating three sites by conducting a combined 
process and product evaluation during the 1975=76 school year. The 
project staff's leadership and classroom teaching activities were the 
subject for the process evaluation i student learning in both the cogni-- 
tive and affective tomnins in grades 3^ 6, 85 and 10 were the subject of 
the product evaluation, 

A by-product of the work during the 1975-76 school year was a test 
administration manual which the Division can use for administering student 
teats in other projects at a later date. 

Conducting Site Visits , The proposal called for PSE staff to conduct 
two-day site visits to the three VEA Part D sites during the period of 
late February to late torch - 

During the site visits, PSE staff interviewed the local program 
directors J school administrators ^ classroom teachers , and students. They 
examined instructional materials being used and visited selected class= 
rooms to observe the program in action. 

Data for these observations were reported individually to the three 
cities. 

Evaluating Student Learning , The proposal also called for a pre^test/ 
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post-test evaluation design for students in grades 3, 6^ 8, and 10 who 
attended program schools and a aalacted number of non^program schools. 

The four cognitive and affective test Instruments PSE administerad 
to students in grades 3^ 6^ 8,. and 10 at the end of the 1974^75 school 
year were reviewed and modified toi 1) Increase the discriminating power 

of the tests I 2) lengthen the affective aection of the tests | and 3) elim- 

. ... ■ / 

inate unimportant items. , 

PSE supervised all production | printing^ and packaging of these tests 
for administration in Ohio* Mthough the tests were administered by local 
personnel in OhiOj PSE monitored the administration by helping to establish 
comparability of eKparlmental groups and control groups (program and non- 
program groups) s determining the sample si^e and composition, and preparing 
test administration materials. 

The results of the pre^test deseribcd the status of the program and 
non-'program students as of October, 1975, The pre--test results and post- 
test results were compared and examined for statistically significant 
differences which demonstrate appreciable growth on the part of the program 
students. Data were also analyzed to determine relative growth across the 
seven developmental areas. The post-tests were used descriptively to re-^ 
port the final status of the program and non--program students at the close 
of the 1975-76 school year* This information can be useful to local program 
directors in planning in-service and guiding teachers during the 1976-77 
school year* EKperimental_groups can be compared to control groi*ps using 
both the pre-test results and the post'-test results in a search for statis-- 
tically significant differences* 

Data on student ability, scholastic aptitude, and demographic charac- 
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tarlatics known to be related to school learning were examined for their 
relationahipa to pra-test status, post--test status and pre-test/post-test 
growth* These results can be useful to local program directors In under- 
standing differential program effects on different types of students. The 
remainder of this document describes in detail the procedures used and the 
findings obtained from the three-site evaluation of career development 
programs - 
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EVALUATION OF PROGR^ PROCESS 
As a part ©f its evaluation of Cincinnati, Clavaland, and Spring- 
fialdp the three VIA Part D funded project sites, PSE agreed to conduct 
two-day site vieite to each city. These site visits were to aasesei 
1) leadership characteristics of the individual programs and 2) classroom 
teaching activities of the program teachers. The procedures and findlnga 
of these site visits are summarized in the following sections. 

Procedures 

During the site visits, PSE Staff Interviewed the local program 
directors, school administrators, classroom teachers , and students. They 

i 

examined instructional materials being used and visited selected class- 
rooms to observe the program in a Ion, 

The major question to be answered during the site visits was what 
classroom activities or staf f^directed activities were Instrumental in 
making the program succeed. By interviewing several people Involved in 
the program and visiting and observing several activities, PSE found 
data that indicated the strengths and weaknesses of the IndWidual programs 
In conducting these ^ site visits, PSE employed the following procedures. 

Preparing ^ Sites for the Visitation ^ Each program director received 
verbal and written notification that his or hei program would be observed 
on two specific dates In the middle of March. ?SE prepared three 
qualified members of its staff who were familiar with career education 
and the Ohio Career Development Progrmi to conduct tfc?ese observations, 
PSE determined to allow the program staff to fife responsible for arranging 
interviews and the observations. It was felt that the type of Interviews 
and obgervatlons that was planned by the program staff would reflect 

18 



their leadership qualities as well as the way they viewed their programs. 
Since thia was not a random sampling of people being interviewed about the 
program^ conclusions and recommendations ^^ere based on the fact that the 
program staff chose who was to be interviewed, PSE made sure that they 
Interviewed members of the program staffs school administrators , principals , 
teachers, and students. 

Conducting Site Visits , The actual dates on which the site visits 
took place werei Cleveland-^^March 11th and 12th , Cincinnati—March 15th 
and 16th, and Springfield — ^^larch 17th and 18th, In each of the cities^ a 
meeting was held with the program director and individuals that he or she 
chose to include in the first meeting. During these meetings ^ the program 
director described his or her program and the goals that had been s6t for 
the 1975-76 school year. From these descriptions , PSE was able to ask 
questions and lead interviews that would help the program director find 
out how successfully these goals were being met. In each of the cities , 
we found that different goals had been set and different methods for 
meeting these goals, 

Following the initial m^titlng, PSE staff were taken to program' ictools 
either by the director or member, of the program staff. While in these 
schools., members of the FSE evaluation team held many formal £.ad informal 

discussions with program staff. They visited schools which would give 

1 

them an overview of tHe^ program^ in other ^wordsj the high school and a 
sample of its feeder junior high and elementary schools. At these schools, 
they interviewed principals , teachers, counselors, and students. They 
observed classroom activities and eKamlnmd classroom and library instruct- 
ional materials. They also reviewed doci^ments on file at the Career Davel- 
opment offices such as program proposals, objectives j previous evaluation 



19 ' 



studies p and program records, ffhey also reviewed forms and processes 
used by the Career Development Program staff. 

Conjerences were held with the Career Development staff or program 
directors at the close of the final day of the visitation to share PSB's 
ebeervations and reco™endations regarding program process • A written 
report describing in detail these observations and recommendations fol-- 
lowad the site visits. The following section sumiarizes the findings 
of the site visits for all three cities. 

Findings 

Using the procedures described above ^ the PSE site visitors obtained 
much information about program processes. This section includes comments' 
on program designs staff ingj in-service educations community supports and 
each of the three components of the program (Motivations Orientations and ' 
^ Exp lor at ion) , Th^ reader is reminded that these findings are based upon 
visit'^made in/ltarch and thus, in some cases j refer to facts which have 
been changed since that time. 

Program Design . All three programs are based on the Ohio Career 
Development Model which is designed to foster student development in the 
seven areas of Individual and Env^^dnments World of Works Self , Economics, 
Education and Trainings Employability and Work Adjustment Skills s and Decision' 
Making, Each program has stated general objectives for students in each of 
the three components , Career Motivation for students in grades K-6 is 
designed to help children become aware of the world of work and to develop 
positive attitudes towards work. Career Orientation for students in grades 
7-8 is designed to familiarize students with various aspects of a variety 
of occupations and to begin to develop an awareness of personal interests 



and ^abilities. During this component, students are also taught about 
the fifteen United States Office of Education occupational clusters* Career 
iKploration for students In grades 9-10 is designed to help students to 
begin to make good career decislona. The overall goal of the program is 
to prepare students for economic independence and an appreciation for the 
dignity of workV' - 

This Is the final year for the VEA Part D funding of these three sites 
for a comprehensive K^IO Career Development Program* Each district has 
individually explored ways to ensure the continuation of ^ the Career Develop- 
ment Program after the completion of the 1975=76 year. One program has been 
actively pursuing other federal money sources while the remaining two are 
applying to the state for future fundings 

In all three cities p the Career Development Program is a vital part 
of the local school district's curriculum* In at least two of the three 
cities, the program staff has been Instrumental In expanding career educa^ 
tion to other areas within the city. 

In all three cities, the program has accepted the responsibility of 
being a model career education program and used its knowledge and experience 
in helping other areas within its school district or within other districts 
within the state to develop new Career Development Programs . 

Stafflng^ * Following the Ohio Career Development Model, all three 
sites are staffed by a program director and as few as two or as many as 
eleven program coordinators. In each of the three cities, these individuals 
are competent p efficient, and hard-working. To a large extent* they are 
responsible for the success of the program in each of the three sites. 

The program directors are responsible and handle successfully the 
administrative tasks associated with the program* These tasks Include 
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meeting with school administrators, conducting In-^service workshops, 
attending stata-wide meanings and providing supervisory assistance for 
their program coordinators* All three of the program directors were well 
Informed concerning their individual school districts and well aware of 
what role career education should play in that particular school district. 

In most cases, the coordinators assist the program director either 
as career education specialists in one of the age^level components or as 
program representatives to an individual school building* In some cases 
they offer expertise outside of the career education curriculum but within 
the realm of the school setting such as expertise in curriculum design, 
in-aervlce education, or evaluation techniques. The role of coordinator 
la uniquely defined by the school situation In which it Is located* In 
all cases, the coordinators we interviewed were well-informed, capable, 
and hard=working professionals, 

In-Service Education 

Each of the three sites has a plan for in-service education. In most 
cases, several types of in-service education are made available to program 
teachers* Prior to the 1975-76 school year, each of the sites has been 
Involved with a university-sponsored in-ser^'^' ig ' inlng session. This 
year the emphasis is placed on more Individual, small group, training 
sessions. These are usually conducted by the program director or program 
coordinators and focus on specific problems, developmental areas, or 
subject areas. 

This type of small group in-servicing app^^as to be very successful 
in meeting the needs of program teachers, guidance counselors, and other 
school personnel. Having coordinators or program directors conducting 
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In-service sessions places these program personnel in leadership roles 

and enables them to influence curriculum decisions^ instructional processes 

and material selection. 

Since the Career Development Program has been active in all three of 
these program sites for the past four years ^ this type of small group in-^ 
service education appears to be the most effective way of reaching teachers 
and infusing career education concepts into the eKisting school curriculimi * 
The teachers we spoke with responded favorably to this type of in-^servlces 
although they did not want to give up their one-to-one contact with the 
coordinators of their buildings or components* 

Community Support . Coimnunity support is divided between two groups 
"industry and business support and parental support* Each individual 
program site has a unique combination of both types of support. In all 
three sites j the industry and business support runs higher than the 
partatal involvement. Each program site is able to conduct its "hands--on" 
experience for its high school component with relative ease. Although 
overall parental support is good for each program ^ it varies within the 
program from school to school. In no way does this lack of parental 
involvement hinder any program ^ but it is an area in which future efforts 
in all three cities can be directed. 

Motivation Component (K-S) . In all three cities in grades K-S, PSE's 
observations revealed the largest number of classroom activities. A strong 
ground work of career developinent concepts is presented at these levels 
with students participating in the largest number of field trips ^ speakers , 
films, as well as Infused curriculum lessons* These teachers* efforts 
ehould be encouraged and might be Tnaximized by a sequence of objectives 
from grade level to grade level to guarantee that students would not 
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experience repetition of the same activity or content area as they proceed 
thrdiigh the motivation component. The development of these sequence object^ 
ives could be made by teachers in the small group in--service sessions as 
they are being conducted throughout the year. 

Orientation Component (7-8) > At the junior high level, career develops- 
ment activities vary from program to prograin, PSE observed a unique ap-- 
proach to career development at this level in each of the three programs* 
The approaches varied from special career education classes to individual 
field'-based nKperlence for Junior high students. In addition to these 
special activities * each program was making an attempt to provide ln= 
service education to regular curriculum teachers and influencing the 
infusion of career education concepts into the regular curriculum* 

The number of teachers at this particular grade level who are involved 
heavily in career education is not as large as that in the Ilotivatlon 
level. In all three visits ^ there appears to be a need for involving more 
junior high school teachers into the Career Development Program. Possibly , 
the focus for in=service education should be the seven developmental areas 
of the Ohio Career Development Program rather than the fifteen USOE career 
clusters * 

EKploratlon Component (9-10) ■ In two of the three cities ^ the weakest 
of the three age level components is the high school component. However, 
PSE feels that each of the three program sites was making strong headway 
in making more high school teachers Involved with the Career Development 
Program* PSE found teacher interest and participation apparent in all 
three high schools. Each program was instrumental in involving the guidance 
department* the library personnel , and several of the academic curriculum 
departments in their individual programs. In at least one of the three 
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progrM sites, tha Career Development Program was working closely with 
academic teachers who were arranging field-based eKperiences for their 
ninth and tenth grade students. 

There is mora and more evidence that the Career Development Prograin 
•is reaching more hish school teachers and consequently 5 more ninth and 
tenth grade students. This area, howevev% is the weakest of all three c* 
ponents and one in which the attention should be directed for future 
planning. 

Summary . PSE found the Career Development Program staffs to be hard- 
working and effective* These individuals should take pride in their many 
accomplishments. Each program has used the Ohio Career Development >lDdel 
as a foundation for building a Career Development Program that is unique 
to its 01^ situation. Our strongest reconmiendation for future efforts 
would be the strengthening of the Orientation and Exploration components. 
Our observations indicate that students are receiving a strong background 
in the Motivation component and are ready for a more extensive Career 
Development Program in the Orientation and Exploration components. 
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EVALUATION OF STUDENT LEARNING 

PSE^S second objective in this study was to determine the amount and 
type of student learning of career education concepts that had resulted 
from the efforts of the three Career Development Programs by the end of 
the 1975-76 school year. We wished to use this information to evaluate 
the success of these efforts thus far and to make recommendations for 
future program efforts , The procedures used in testing students to gather 
this information and the findings obtained through these tests are 
described in this section* 

PrQcedures 

The major focus of this part of the evaluation was the amount and 
type of learning of career education concepts displayed by the Career 
Development Program students as revealed by tests developed in Ohio, The 
evaluation design called for a pre-test to be administered in late October 
and a post^test to be administered In early May. This design offers 
several types of information. The results of the pre'-test were analyzed 
to produce the description of the status of the program and non~program 
students as of October^ 1975. The pre-'test results and post^test results 
were compared and examined for statistically significant differences 
which would demonstrate appreciable growth on the part of the program 
students. Also, data were analysed to determine relative growth across 
the seven developmental areas. The post^tests were used descriptively 
to report the final status of the program and non'-program students 
at the close of the 1975-76 school year. This information can 
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be useful to local program diryctors in planning In-service and gulQing 
teachers during the 1976-77 school year. 

Each local program director received a detailed report on his/or 
her city. EKperimental groups were compared to control groups using both 
the pre=-test results and the post'-test results to find statistically 
significant differences. Data on student abilityj scholastic apuitude, 
and demographic characteristics kno^m to be related to school learning 
were eKamined for their relationships to pre^test status and pre^test/ 
post--test growth. These results can be useful to local program directors 
in understanding differential prcgram effects on different types of 
students* The following sections describe procedures employed by PSE in 
Instrument development, sample selection^ administrations and data 
analysis , 

Instrjjment Developinent . During the 1974^75 school year, PSE was 
involved in on^^ite areer education item development in a number of 
Ohio cities. During visits to these sites, PSE staff created career 
education items and pilot tested them with a samiple of students* These 
items deal with career education concepts in each of the seven develops 
mental areas of the Ohio Career Development Model , 

Each item was tested on both Career Development Program students 
and non-program students, in the city where it was created as well as 
in other Ohio cities. The outcome of these efforts was a pool of career 
education items in various developmental areas that tesced both cogni^ 
tive and affective learning and showed program students to have knowledge 
superior to that of non^-program students. 
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From this pool of items, PSE selected the most effective items to 
construct cognitive and affective tests of career education concepts for 
students in grades 3 5 6, 85 and 10* Each item was selected to appear on 
one of the four grade level tests because it was judged to be at the ap^ 
propriate reading level (that iSj neither too difficult nor too easy for 
students at that grade level) and because it revealed differences in 
student learning between program and non^program students* 

Each test Included items froin each of the developmental areas ^of the 
Ohio Career Development Model* These tests were administered in a number 
of cities including Cincinnati , Cleveland ^ and Springfield in the spring 
of 1975* Results were used at that time to make recommendations to 
these programs * 

Instrument Revision 

This years PSE used the results of last year's testing efforts to 

revise these tests in several respects so that they would yield even 

better information about student learning* The following review and 

modification steps occurred: 

1» The affective section of each test was lengthened 
from 20 to 40 items to increase the reliability of 
this section. 

2, Each test was reviewed to locate and eliminate items 
which did not discriminate between program and non- 
program students when administered during the 1974'=75 
school year, 

3* Staff of the Ohio Department of Education Division 
of Vocational Education and representatives of local 
programs reviewed all items for Importance of content, 
and PSE eliminated any items which they rated as 
unimportant or neutral. 
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PSE used the same developmental area assignments that were made during 
the 1974-75 school year for tha items to be used in the revised test* The 
distribution of items in each developmental area is represented in Table 1* 
Wien items were eliainated and replaced by new items ^ an effort was made 
to replace the old item with an item from the same developmental area. 
Ail seven of the developmental areas are represented in all four grade 
levels* The number of items within each developmental area was deter^ 
mined by the number of items that discriminated in favor of the program 
Students during the 1974-75 pilot testing* PSE felt that this distribution 
of items reflected the emphasis being placed by the local programs on 
each of the seven developmental areas at each of the grade levels. 

Each revised test contains 80 fteras and is evenly divided between 
multiple choice questions reflecting cognitive content and agree^disagree 
items reflecting affective content* 

The tests, in totals represent cognitive and affective content areas 
which are appropriate for the grade levels which are Judgad as important 
by State and local programs ^ and which discriminate between program 
and non=program students* The same instrument was used at each grade level 
for both the pre- and post-^tests. 

Sample Selection * PSE's objective was to administer pre- and post"' 
tests to a sample of approximately 375 program and 125 'non^-program 
students at each grade level In each school district* We felt that this 
would be a sufficient r^ample si^e to adequately represent program and 
non--program students even after each group was subdivided by sex, racej 
etc* For ease and consistency of administration, entire classrooms of 
students were tested at one time. Therefore^ classrooms rather than 
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Table 1 

Kumber of Items in Each D g \^ a 1 o p m en t a 1 Area a t )l nch Q r n d e L g v el 

Pre-test / Post Test 
Revised 1974^75 Field^based Test 



DEVELOi'Kr-irrAL 






fiRAT)')'' S 


GMDE 10 


IndividuGl and 
Envi ronnjent: 


15 


8 


12 


11 


World of i:ork 


18 


17 


20 


12 


Self 


22 


18 


15 


14 


Economics 


8 


9 


6 


9 


Education and 
Training 


9 


12 


8 


12 


Eoployftbility £ind 
l-^ork AdjustiLcnt 




6 


11 


10 


Decision Waking 


4 


10 


8 


12 


TOTAL 


80 


80 


80 


80 
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individual students were selected to form the sample. Using the following 
method^ we drew a sample of fifteen classrooTns of program students and 
five of non^prograra students at each grade level to include approximately 
500 students in both groups at each grade level from each city* 

In order to be able to make comparisons we wished to select similar 
program and non-prograin students. Every program school in each district 
was included in the population from which classroom teachers would be 
selected. Non-program schools were selected according to the following 
procedure* PSE asked the local program directors to collect the following 
information for each of the four grade leveLs for each school in his or her 
program: mean reading scores, I.Q* scores, grade point averages, and 
socio-economic indicators, ^sniere nil such information was not available, 
the program directors worked with those factors available which would 
best assist in making such decisions. The program directors then attempted 
to identify an equal number of non^program schools whose student scores 
most closely matched those of the program schools, 

Nexts the program directors compiled an ordered list of all teachers' 
names from program and selected non-program schools at each of the four 
grade levels. With the assistance of PSE staffs they, then, randomly 
selected' fifteen program and five non^program teachers at each grade 
level. At the elementary level, the en i: ire class of each of the teachers 
selected was tested. In grades 8 and 10, either English or social studies 
teachers were selected so that classes tested would consist only of 
aighth or only of tenth grade students. In some cases where English 
or social studies classes combined grade levels, an alternative subject 
area was chosen. 
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The Identical samples of program and non-*program students were used 
for both pre^ and post^tests In order to anaure that the most reliable 
pre^test/post^tist comparison could be made. 

Admlnis t ra t ion , Pre=tests were administered in each city during the 
weeks of October 29 to Noveraber 10^ 1975 # PSE constructed the test for 
each grade level and created directions for administering the tests. 
The appropriate number of copies was shipped to each program director^ 
who was responsible for arranging distribution and administration of the 
tests in the selected schools p In some cases teachers administered the 
tests. In others s the coordinators administered the test in their own 
' buildings and in non-'program schools. The program directors then collected 
the completed tests and returned them to PSE for scoring and analysis. 

The post^tests were administered during the week of May 3-7 ^ 1976 , 
in order to allow program students the entire school year to benefit from 
program efforts* Tables 2^4 display the actual number of students tested 
in each city at each grade level in both the pre^ and post^tests* 

Data Analysils * Data for the cognitive and affective tests were 
analyzed separately by pre--test or post-'test forms city, and grade level. 
This allowed PSE to compare the post^test results with the pre^test results 
and to determine what changes ^ if anyj had occurred in the students' 
cognitive learning or affective learning* 

For both the pre-test and the post-test ^ program and non-program 
scores were obtained for an itc-n, for a group of items (e,g.i items 
that were classified in the developmental area of Self)* and for the 
complete cognitive or affective test sections. In this way* 
PSE could determine if the changes in program student learning were 



32 

* I n 
u i 



Table .2 

Number of Program and NQn-ProgrdTn Students TesUGd at Each Grade Levol 

In Cine Inna t i 



GRADES 


PROGRAJI STUPErsTS 


_ NOK-PPOGRAW . STUDENTS 




POST 




PORT 


3 


396 


413 


114 


132 


f— ' =1 


386 


374 


115 


139 


8 


357 


236 


91 


89 


10 


152 


268 


114 


69 


TOTAL 


14 PI 


1291 


434 


429 
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Table 3 

, Nuffibsr of Program and Non-Program Students Tested at Each Grade Lavel 

In Cleveland 



GRADES 


_ PROGR,ij-I STLrDEMTS 


■sOa-PROORAM STUDEifTS 








PORT 


3 


361 


329 


150 


144 


6 


385 


391 


138 


141 


8 


419 


413 


93 


119 


10 


302 


265 


105 


97 


TOTAL 


1467 


1398 


486 


501 
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Table 4 

_Number of grogram and Non-Pro gram jtudents Tested at Each Grade Level 

In Springfield 





GRADES 


i-'PROGRA^r 


STUDEnTS 


NON-PR^rRAM STUDEOT,?i 






pnsT 




_- ^ :W..^<i ^ 




3 


360 


332 


91 


1 

■"79 i 




6 


383 


355 


94 


89 




8 


347 


343 


130 


144 


ii ■ 

iVm'- '- ■ 


10 


333 


282 


120 


108 


1 


TOTAL 


1,443 


1,312 


435 


420 
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c&used by the program Itself or ware simply the results of normal claes- 
room learning. Comparisons were also made between various student groups 
to see if the program was affecting a certain group of students more than 
another group « 

Thesa comparisons were based on the number of program students res- 
ponding correctly to an item or group of items as compared with the 
number of non-program students answering correctly that item or group of 
ItMs- A single-stalled test of significance was calculated to determine 
if the program has actually caused the positive effect. This significance 
is represented by a "t" valued Table 5 shows the level of significance 
of selected "t" values for different population sizes* 

The *05 level of significance means that the measured differences 
between two groups—such as program and non--program"would not occur by 
mere chance more than five percent of the timep that is, more than five 
times out of a hundred. Similarly ^ the ,01 level of significance means 
that the difference would not have occurred by chance more than one time 
in one hundred. This menns that the *01 level is higher or better than 
the .05 level. 

Findings 

As mentioned previously, the results for each test administration 
were reported by it^^ by developmental area groupings^ and by total 
cognitive or affective test scores for each city, each grade, and each 
student group. The detailed findings for each city appear in Appendices 
2 through. 5* A comparison among the three cities appears in the 
following sections. . : [ 
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Ta ble 5 



Level of SlgnlflGance 





Group N 


*05 Leval 


J - 1 : 

.01 Level 




120 


1.66 


2.36 




60 


1.67 


2,39 




30 


1.70 


2.46 




15 


1.75 


2.60 

- 
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In general p we will be dealing with the poit=test data which shows the 
status of eaeh Individual city at the end of the 1975^76 school year* 
In soma easeSj we will be looking at the pre-teat/post-teat changes that 
ocaurred during the currant school year. 

Student Characteristics , The number and percent of program and non^ 
program studenti participating in both the pre-test and post-^test admini= 
strations in each city and the breakdoTO for various demographic groups ^ 
appear in the findings sections for each city and are presented in 
Appendix 2, The pre- test was administered to approKimately 1^400 
program students and 435 non-program students In each city, while the 
post-test was administered to approKimately 1,300 program student and 439 
non^program students in each city. The number of program students 
participating in both the pre-test and post-^test was sufficient to 
represent the program at the various grade levels in each city. Likewise, 
the number of non^program students compared to program students for both 
tests administrations was also large enough at each grade level in each 
city for the various comparisons which were made. 

In all three cities , both the pre-»test and the post--test populations 
contained approKimately an even division between boys and girls at each 
grade level. The distribution between Black and other students and 
white students for each city varied. In two of the three cities, 
however, the distribution was consistent among the four grade levels. 
That la. If the program contained more Black and other students in grade 3, 

it usually contained more Black and other students in grades 8^ and 10 

4 

also. The tenth grade program population for each city contained fewer 
students enrolled ^livan academic curricula than students enrolled in 



curricula other than academic. 

In two of the three cities, the choice for non-program populations 
appeared to be as good as we would have hoped to find* The ratio betwean 
program and non-program etiidwts of various demographic groups, as well 
as the Information providad by the program directors relating to school 
learning (e*g.j I.Q, scores, reading scores, and socio-economic status) ^ 
indicate that students of both groups-^'-program and non-program— were 
stoilar. Therefore, the difference between program and non-program 
learning can be attributed to program efforts^ rather than other learning 
factors* 

Unfortunately, the choice of non-^program schools In Springfield 
did not result in a clear distinction between program and non-program 
populations for grades 8 and 10. In both of these grades, it was felt 
by the local program director that the non-program students were also 
being Instructed in concepts concerning career education* Thereforej 
- the program students in Springfield needed to be extremely well 
Informed and hold extremely positive attitudes In order to score 
better than their non-program counterparts. 

For the various analyses which were made of the data, sample size 
was considered when computing the "t" values* With the exception of 
the Sprlngleld eighth and tenth grade populations, PSE feels that the 

rati© of program students to non-program students and the Information 
supplied by the program directors Indicate that the overall program and 
non-program groups seem to be as comparable as we could hope to find. 
Overall Results. The overall cognitive and affective post-test 
results show that in all three cities the program students In grades 
3 and 6 were able to end the year knowing somewhat more about career 

39 



.edueatlon and holding slightly better attitudes toward career edueatlon 
aonoepts then their non-program counterparts. Students in grade 8 in 
two of the three cities were also able to end the year scoring somewhat 
higher than their non-'program counterparts on both the cognitive and 
affective tests. However * the tenth grade students from only one city 
ware able to end the year showing more Imowledge or better attitudes th 
their non-program counterparts* Even though the program groups were 
able to show more knowledge or better attitudes, the difference between 
program and non-program scores was statistically significant in the 

Cincinnati^ Grade 3, Cognitive and Affective tests, 

Cincinnati, Grade 8, Cognitive test. 

Cleveland, Grade 10, Cognitive and Affective tests* 

For these three cases, the program made a measurable Impact on 
its students. In all other cases, it is evident that the program is 
influencing its students In each city, but not to the extent that their 
test scores can reflect significant differences between program and non- 
program learning. 

, In general, when the program makes a significant impact on the 
cognitive learning of its students. It also makes a considerable impact 
on the affective learning of its students. However, in other Instances, 
where- the cognitive tests scores of the^program students are only 
slightly higher than the cognitive tests scores of non-^program students, 
the affective scores ate relatively close for program and non-program 
students. In conclusion, when the program provides Its students with 
considerably more information than the non-'program students, it is also 
able to Influence the attitudes of its students to a larger extent. 
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Results for Davelopmental Areas , In total , all three Career 
Development Programs are attempting to provide their students with a 
well-rounded approaoh to career education. Each program district, as 
well as the grade levels within the districts , has its own different 
strengths and weaknesses. V^ere the program has made significant 
differences between progrms and non-^program learning, the differences 
appear In all seven of the developmental areas"r In other instances, 
where the difference between program and non-program learning is not as 
distinct I the strengths or weaknesses show up in various developmental 

areas. The strengths and weaknesses of various grade levels in different 
program districts are discussed In more detail in Appendix 2, 

The overall results for all three school districts indicate that 
the program students are able to answer questions in each of the seven 
developmental areas on either cognitive or affective content. These 
results , suggest that the programs are attempting to reach all students 
with each of the seven developmental areas. _ 

Results for Boys and Girls , The results for both the cognitive 
- and affective tests were also analyzed to locate differences between pro- 
gram boys and non-program boys and also program girls and non-program 
girls. These results for each city are presented in greater detail in 
Append 1k 2« 

In general, the post-test scores for program boys and program 
girls at each grade level in each city were similar. These results 
indicate that both program boys and program girls are benefitting from 
the program. In other words, where the program has made an impact on its 
students, it has influenced the learning of both program boys and program 
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girls to the Bmae extent* 

Results for Black and Other Students and White Students . The pre- 
teat and poat--test data were also analyzed to determine if the program had 
more effeet on either of two demographic groups i one group contained white 
students; the other contained all Black and other atudenta. A detailed des- 
cription of the findings on these two groups in each city appears in Appendix 

In summary, when the program was able to make an impact on its 
studanta in a certain grade levels it generally was able to benefit both 
Black and other students and white studenta to the same degree. In moat 
cases I there was discrepancy between Black and other program students* 
and white program students' scores on the cognitive and affective tests. 
The white program students tended to score somewhat higher than the Black 
and o^her program students, Howeveri when comparing both program groups 
to their non--program counterparts, both program groups were able to score 
higher than their non--program matches an equal number of times* There^ 
fore, it appears that the program is able to supply both Black and 
other program students and white program students with enough career 
information and activities to influence their learning and give each 
group an advantage over the learning of their non-program counterparts. 

Results for Academic and Non— Academic Students » At the tenth 
grade level, a comparison was made to determine how the program had 
influenced the learning of its students enrolled in different curricula. 
The tenth grade students were divided into students who were enrolled 
in an academlc^college preparatory curriculum nd atudenta enrolled In 
non^-acadraiic curricula (curricula other than ac ic)* The details of 
thie analysis appear in Appendix 2 also. 



In all three cities » the academic program students began the year 
with the slight advantage over their non-acadaraic cQunterparta. This 
Is not unusual In that academic curriculum usually contains students who 
are preparing for college and professional careers and, consequently j 
contains the better students at a given grade level. 

Even so* the most dramatic impact of the program was noticed in 
the non^academlc results. For examples in Springfield , the non--academic 
program students were able to raise their score sixteen points on the 
cognitive test and eighteen points on the affective tests between the 
pre*-test and the pQst=test, In general, the program has been able to 
show a greater Impact on its non--academlc students than Its academic 
students when comparing their scores on the pre-test and post-test* 

As has been mentioned earlier, tha tenth grade Is the weakest 
eomponent in two of the three cities* VThere it has been able to make an 
impact on its students ^ It appears to ba affecting the non-'academic 
students more than the academic students^ Apparently, the academic 
students in both program and non-program schools are able to learn 
ftbout careers from sources outside of the schools. Consequently , the 
difference between program and non-program learning for academic students 
is not that great. This leads us to the conclusion that in order for the 
program to make an impact on its tenth grade students | it must provide 
the non-academic students with more information and more experiences 
than their non-program counterparts* 
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CONCLUSIONS AND RECOtflffiNDATIONS 

Based on our obaervatlons In the three program districts and the 
results of the pre-tests and poat-testa, PSE offers these final conclu- 
sions and recoTOoendations. 

The program ataffa In the three districts have been euccessful 
in modifying curriculum and influencing student learning to the extent 
that I 

1# Program studenta in grades 3 and 6 in all three districts ended the 
school year with higher scores on the cognitive tests than the non- 
program studenta from each district* 

2. Program students in grades 3 and 6 in all three di'^iricts 
completed the year displaying attitudes equal to or slightly 
better than the non^program students as evidenced by the 
affective post-test results, 

3. Program students in grade 8 in two of the three districts 

were able to end the year with highsr scores on both the cognitive 
and affective tests than their non-program counterparts, 
4* Program stiidents in grade 10 in one of the three districts 

were able to complete the year with higher scores on both the 
cognitive and affective tests than their non-program matches* 

5* Program students showed greater superiority on the cognitive 

tests than on the affective tests* 
6. The typical student—both program and non--program— found the 

affective test to be slightly easier than the cognitive test* 
7i At most grade levels in all the districts , the program 



studante' post-test acores indicate growth in cognitive learn- 
ing and, to a leeser eKtent, growth in affeetlve learning. 
8* Program BtudentSi at all four grade levels in all three 

districts I were able to answer cognitive and affective ques-^ 
tions In each of the seven developmental areas. Each program 
district J as well as the grade levels within each district, 
has its o™ strengths and weaknesses as shown In the indivi- 
dual district's results for developmental areas. 
9. In general, in the grade levels where the program has 

influenced the cognitive or affective learning of its students 
It has influenced both program boys and program girls. 
10* Although white program students at all four grade levels 
tend to score higher on the cognitive and affective tests 
than the Black and other program studentsi the program in 
each district appears to have influenced both Black and other 
students and white students, 
11* Although the tenth grade academic students in each district 
have a slight advantage over the non-academic program 
students, the non-academic students appear to be benefitting 
somewhat more from program efforts than the academic students* 
These conclusions suggest that to a, large extent the progrmn in 
^ch district has been able to influence the learning of Its students* 
Each program has made an impact on different groups of students at dif- 
ferent grade levels. In general, the program appears to have made 
slightly more impact on the cognitive learning of its students, than the 
affective learning. Also, the program appears to have been most 
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auecegsful iu the elementary grades, less successful In tha junior high 
grades» and least succassful in the senior high grades* 
Further conclusions indicate thati 

1. For the most part^ program directors and coordinators in all 
three districts have taken on the rasponsibilities of leaders- 
ship in career development and have provided their teachers 
with the necessary information,^ materials, and eneouragament 
to djnplement successful Career Development Programs that can 
show maaaurable dlfferencas in student learning. 

2. Program staff have also been Instrumental in obtaining 
support from their local administrators and Boards of Educa= 

.tion In varying degrees. 

3« In at least one district, program staff have also been able 
to Incorporate career education ideas and concepts into the 
existing city=wide curriculum, as well as the curriculum of 
the Individual program schools, 

4, High quality ln=sarvice has been provided through progrM 
efforts in each district and continues to be an effective 
method for reaching teachers and Influencing change within 
the districts, 

, In summary, program directors and coordinators have proven to be 
capable of assuming a leadership role in the Infusion of career develop- 
ment concepts into their local school districts. They have approached 
administrators and policy makers and appear to be providing a means 
for the expansion for career education throughout the district. They 
should be encouraged to continue to have model programs » The oxpertise 
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of the Individuala involved in each program can provide excellent 

resourees for new programg* 

PSE would also offer these additional recommendations for the 

state to consider in planning future program development. 

If The leaders from these experienced programs could be used in 
eenductlng in-service for newer districts. The State Depart- 
ments could a^k Individuals who are experienced in career 
development to act as consultants and assist the newer 
programs in establishing goals and procedures for their 
Initial attempts in the Career Development Program* 
2. The State could use the eKperlence of program staff and 

teachers in each of these districts in setting up a state^wide 
cojraittee to develop a conceptual model of career development. 
This model would define in greater detail the concepts and 
expected student learning outcomes for students in all 
eleven grade levels (K-^10) * 
3i Future program development should consider teaching methods 
and activities that would provide program students with a 
better learning experience during the Orientation and Explora- 
tion components* 

4. Consideration can be given to developing methods of instuction 
and activities for special population groups (gifted j learning 

'^^disabledj disadvantaged j etc*). 

5. The function of guidance and placement personnel in the Career 
Development Program could be researched mth the intention of 
setting guidelines for the school districts throughout the state 
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6* A more defifiite role for coimnunityp busineis, and labor in 
relation to the Career Development Program could be investl-- 
gated so that these resources would be used to the fullest 
: ^ »tent by local school districts. 

It appear e that each of the three VEA Part D funded programs have 
"iiL .the course of four years developed effective comprehensive 
Career Development Programs and that future program efforts could be 
directed towards reaching special student populations while resolving 
apecial problems that have arisen since the inception of career educa- 
tion in Ohio, 
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This report contains the results of the observations of the 
Caraer Development Prograni by PSE personnel in the Cincinnati City 
School District on March 15 and 16 th* 1976, A total of six 
person/days of sunh observations underlie this report. 

The criteria used as the basis for this evaluation were the 
program objectives and descriptions in the proposal entitled i 
Demonstration Project In Career Development ^ submitted to the Ohio 
Department of Education Career Development Program by Cincinnati, 

During the observations carried out for this evaluation, we 
visited the Cincinnati City School District Education Center, Aiken 
High School, Its two "feeder ■■ junior high schools, and two of the 
eight "feeder" elementary schools in the Aiken attendance area. We 
conducted interviews with school administrators j one of the two 
remaining career education Coordinators , Cincinnati's Associate in 
Program Evaluation who serves as Internal evaluator of the Career 
Development Program^ counselors j teachers i and the students. Class- 
rooms were observed in schools encompassing grades K^IO, Curriculum 
guides were reviewed and a variety of instructional materials were 
examined « 

A conference was held with the Program director at the close of 
the final day of observations. This report includes much of what 
was shared with her during that closing session, 

Ch 1 e f Co nc 1 us 1 o n s 

1. The Aiken High School attendance area (approKimately 8000 
students) Is in its final year of the Federal Vocationnl 
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Edueatlon Act Part fi funding as a state-sponsored program 
ia career education* It was organised and is operated under 
the direction of the Division of Vocational Education of the 
Cincinnati City School District. 

The Program has been successful ir many ways in incorporat- 
ing career education concepts into the regular curriculum 
In the elementary and junior high schools, (It has not been 
successful in the high school as explained later.) The 
Program director and staff have been successful in gaining 
the support of most building principals. Moreover ^ the 
Cincinnati Board of Education has supported the career 
education effort j although it has not adopted career educa- 
tion as its top priority. On balance^ we believe that 
career education will become a perTDanent part of the Cln-- 
clnnatl curriculmrij certainly in the elementary and Junior 
high schools. 

The Program director is assisted by two career education 
Coordinators* (A third Coordinator recently resigned and 
that vacancy will not be filled.) One Coordinator is 
responsible for the three secondary schools and is assisted 
by the guidance counselors In those schools. The other 
Coordinator works with the eight elementary schools and 
receives help from an Instructional Aide (paraprof essional) 
in each building. These full*-tlme Aides are usually members 
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of the coimunity aurrounding each school. 

The Program director considers these Instructional Aides 
to be very success fiil in encouraging teachers to modify 
the elementary program to assure the changing of students' 
attitudes toward work, self, and future education. How^ 
ever^ while we were making our observations In Cincinnati * 
none of these Instructional Aides was available to speak 
with us and to describe his or her activities. We think 
that the success of the career education program In the 
elementary schools should more realistically be credited 
to the efforts of the excellent j f oreward-thlnklng, com- 
munity-aware principals. Teachers, in general ^ are 
hesitant to make changes even upon the suggestion of 
their professional peers* Thus we find it doubtful that 
the new Ideas for change offered by the Aides, even 
though they are respected members of the school community, 
would be readily heeded and adopted by teachers. The 
principals we spoke with demonstrated a clear Interest 
In and understanding of career education and seemed to us 
to be the key^ thus far, in getting teachers to see the 
value of career education. 

The secondary school career education program took a turn 
upward in November, 1975 with the arrival of a new Coordin- 
ator, She has done much to bring about the usage of the 
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Orientation and EKploration objectives and activltiei in 
programs entitlad: C,0>G. (Career Orientation Guidance) 
prograro^ and SCORE (Shadowing Career Opportunities for 
a Relevant Education) . C*O.G, is a guidance program of- 
fered in one junior high school to all sevet.tht eighth^ 
and ninth grade students each morning In the home room 
period* SCORE is a simulated and "hands-on" eKperience 
effort in the 9th and 10th grades. Unfortunately, 
both C.O.G. and SCOK.E are more successful in one junior 
high school than in the other. Perhaps more important, 
SCORE Is not effective in reaching students In the tenth 
grade of Aiken High School. In spite of the sincere ef- 
forts of the Coordinator and the Aiken High School voca- 
tional guidance counselor, the career eKploration program 
at the high school is doing poorly In meeting the objec= 
tives of the Program as originally proposed to the Ohio 
Department of Education, 

The Cincinnati City School District has been involved in 
the process of restructuring its educational program to 
comply with Federal regulations to achieve racially equl-- 
table standards In education. Classroom teachers have 
been transferred from one school to another in a reloca= 
tion intended to provide racial balance in the teaching 
staff at the various schools. These transfers have re-- 
moved from the Aiken attendance area a number of class^ 
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room teachers who were eKperienced in and enthusiastic 
about career education. This Is evident most dramatic 
cally in the elementary schools, where a majority of the 
teachers have been moved from the schools and have been 
replaced by a new group of teachers. These new teachers 
have been undergoing in-service training in career educa- 
tion during 1975-76 ^ a process which is still underway. 
In tiinej they presumably will gain experience and be 
as capable and effective In career education as the 
transferred teachers* Meanwhile , the transfers have pre- 
vented the Career Development Program from building a 
strong leadership core of people who have been Involved 
with career education classroom instruction over a long 
period of time. It is trues of course^ that transferring 
experienced career education teachers out of the Aiken 
attendance area may have helped spread career education 
to other schools. ThuSp it may prove over the long term, 
to liave had a very beneficial effect in advancing career 
education throughout the Cincinnati City School District* 

Another move in Cincinnati which has an especially inter- 
esting potential benefit for career education is the 
establishment of "alternative schools." Cincinnati is 
establishing such schools as another approach to achlev^ 
ing a desirable racial balance. Such schools are intended 
to demonstrate that the city can offer equal educational 



55 



opportunltias to all students and ean attract students 
of dlverae backgrounds. 

The "alternative" concept is being used throughout grades 
K-12. to example from the elementary level would be a 
school which emphasizes the arts and humanities* Students 
from the second grade up to the sixth grade who have 
been Idantified as especially gifted in music, art, etc. 
would have the opportunity to attend this school on a 
full-time basis* Other alternatives are available for 
junior high school and senior high school students. 

For students attending such "alternative" schools, the 
special character of the offerings should facilitate their 
career motivation, orientation, and explorationi More- 
over, these particular schools should help the school 
staff, parents, and the larger community gain a better 
understanding of the value of career education and how 
it can be accomplished through such arrangements* It 
appears clear to us that "alternative" schools and career 
education are complementary and that their interdependence 
should be fully supported by administrators as well as by 
career education personnel. 

In grades K-6, our interviews and observations revealed 
a number of classroom activities that stress career 
education concepts and encompass the full range of 
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devalopTaental areas • 

Thm heavy use of paraprof essional Instructional Aides 
may ba creating two problems for the Career Development ' 
Program* The appointment of these special career educa-- 
tlon assiatants may be causing teachers to abdicate their 
roles as the main career education leaders In their class 
rooms. They can easily make the excuse that someone else 
(the Initructlonal Aides) are responsible for conducting 
career education and that the professional classroom 
teacher can abandon It as a matter of personal concern 
and professional responsibility* 

The second problem is that the use of paraprof essional 
rather than professional staff members may undermine the 
leadership role of the career education Coordinators, 
^Jhile the Instructional Aides undoubtedly provide a valu- 
able service in helping teachers arrange and conduct 
trips. Invite speakers p and hold other special events 
which are important for career education--^espacially 
those entailing community involvement— the Instructional 
Aide cannot be expected to substitute for the Coordinatbr 
The Coordinator is still needed to communicate the 
general concepts of career education, to suggest how 
career concerns can be infused into all subject fields, 
to suggest sources of outside help, and to serve as a 
respected," experienced * professional colleague whose 
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andorsement of and enthusiasm for career education can 
be contageous to other teachdrs with similar backgrounds 
and training* 

Parental and comaunity involvement with the school and 
with the career education program varies from building 
to building. One school that we visited (a non-graded 
'^alternative" school) enjoys a tremendous amount of par-- 
ent and comiunity Involvcrnent Including field trips and 
visitors to the school. In addition j this particular 
school offers its students a number of career^related 
reading programs, audio-visual TriaterialSj simulation 
aetivitleSj small business operations , and so on. This 
school exhibits all of the elements that should guarantee 
the success of career education. It appears that the 
determination and leadership of the building principal 
was the key factor in making this school a lively i excit- 
ing j career^relevant place to learn. 

Another school we visited (the largest elementary school 
in Cincinnati) has little parent or coiranunlty Involvement ^ 
partly because the building is not located in a place 
where such involvement can be conveniently arranged • In 
addition to this disadvantage j the school has a faculty 
that is largly new because of faculty transfers made to 
achieve racial balance. In short, the school appears to 
have little in the way of natural circumstances or avail- 
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able rasources which eould make it successful in career 
education* Nevarthaless j thanks in large part to the 
determination and leadership of the school principal, 
career education is undeway. The principal has stressed 
the need for students to gain positive self confidence 
and he has conveyed this need to his faculty* He sees 
in career education an especially suttabla means for 
acconiplishing this and he has accord^'rjly encouraged the 
faculty to operate a career-oriented program* Their 
ifesponse to his leadership is a tribute both to him and 
CO their willingness to build a program despite the lack 
of readily^available conununity resources. 

The process of career education at the two schools is 
decidedly different * but we felt positive about what we 
heard and what we observed at both. 

In grades 7-8 our interviews and observations revealed 
rather extensive Career Development Program staff involve' 
ment and the presence of numerous career development 
activities • 

The television series '*Self Incorporated" produced by 
the Agency for Instructional Television (AIT) is being 
used successfully in the seventh grade. 

The Career Orientation Guidance Program (C,0,G,) is being 
used at both schools , but with more success at one* The 
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teachers at the other desire more information and 
^idance from the career education Coordinator, Some 
seem to be doubtful as to how thay should use the avail- 
able career education materials with their students • 
This school made a rather late start in career education 
this year but appears to be progressing. 

Guidance counselors are used with success at both 
schools. The counselor in the junior high school that 
has the more advanced program feels that the introduc- 
tion of the Career Development Program into the school 
has done a great deal to mke classroom teachers aware 
of. what students gain through having career concerns 
Introduced into the various subject diclplines they are 
teaching. Clearly, the introduction of career concerns 
into the malnst.ream of the classroom Is a powerful addi- 
tion to what a guidance counselor can accomplloh alone. 
The counselor stated that "The career concept is true 
and valid*- and offered the opinion that "this junior 
high school will never be the same," It is obvious to 
anyone familiar with career education that guidance 
counselors are In a good position to assist career educa- 
tlon Coordinators in communicating with and relating to 
classroom teachers. Moreover ^ the counselors have the 
opportunity to work Individyaly with students and to 
assist teachers in various ways. The counselors we met 
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in the Cincinnati junior high schools seemed very inter- 
ested in career education and appear to be a definite 
source of support for it. 

Principals at both Junior high schools have generally 
positive attitudes toward career education and both 
serve as "models" to their faculties in their personal 
participation in all career education activities * in-- 
eluding in-^service training sessions. 

The counaelors responBible for 9th grade students in 
both junior high schools are involved in the career 
education program^ chiefly in the capacity of arranging 
''hand-on" eKperiences as a part of the SCORE program* 
Students request the counselors to arrange such exper^ 
lences; the counselors precede the individual student 
field visits with group orientation sessions designed to 
enhance the value of the out^-of -^school experience. 

As indicated above, one junior high school has a more 
niature, stronger, career education program than the other. 
In th^ school with the better prograins the participation 
of 9th grade students in SCORE has Increased since Decem- 
ber, Unf ortunately s however 5 due to some misunderstandln. 
batween the Coordinator and the 9th grade guidance coun-- 
selor In .that school, SCORE "hand-on" experiences have 
not been scheduled for students for April, May and June 
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of this year* Hopefully, the mis communication will be 
corrected so that this valuable aspect of career educa- 
tion can be fully used in April, tiay and June, before the 
9th graders move into senior high school* 

As previously Tnentioned, the Aiken High School 10th grade 
program is doing poorly in meeting the objectives of the 
Career Development Program* The school is divided phy= 
sically .between college preparatory and vocational educa- 
tions sections i and seemingly "ne'er the twain shall 
meet*' philosophically or ideologically. The school's 
academic teachers evidently envision their role as that 
of preparing college^bound students^ despite the fact 
that over 50 percent of the 11th grade and 12th grade 
students are enrolled in vocational courses. Moreover, 
the teachers appear to conduct their teaching largely 
within the four walls of their classrooms and make little 
use of conmunity resources. Such attitudes and practices 
are understandable, given the origins of Aiken High 
School. Originally, the school was intended to be a 
high-prestige academically^orlented college-preparation 
high scho'^1. Over tlmei many non-college--bound students 
enrolled and a vocational education v^lng was constructed 
to offer courses to meet their needs. The academic 
faculty has not yet come to terms with the changing role 
of the school J as vocational enrollment continues to 
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rise at the aKpense of acaderalc enrollraent. Thus, it is 
perhaps fair to conclude that not only the philosophies 
but perhaps even the livelihoods of the academic teachers 
are being threatened. This may be a special reason for 
the difficulty the Career Development Program staff has 
had in interesting the academic teachers at Aiken High 
School in career education. Whatever the reason ^ SCORE 
is not succeeding at this school and career education 
does not exist* This is unfortunately, especiaJly for 
future career education plans and efforts in Cincinnati 
as a whole. The elementary and junior high school pro- 
grams in the Aiken attendance area are good and improv^ 
ing. To see many of the desires and expectations of 
parents* the efforts of teachers and administrators * and 
the enthusiasm and participation of the elementary and 
junior high school students ignored by what should be 
the capstone senior high school is truly unfortunate. 
The program starts well in the lower and middle grades 
but ends poorly in the upper grades* This is especially 
unfortunate to the extent that the program is intended 
to be a Taodel for replication throughout the Cincinnati 
City School District, 

The vocational guldancG counselor at Aiken High School 
expressed certain ideas as to how the program could be 
turned around next year with some restructuring of the 



mtmmB of responsibility and the lines of coBraaunicatlon 
within the building.' His ideas sounded reasonable. We 
very much hope that they can be put into effect. 

We were not able to meet with the principal of Aiken High » 
School beeause he was out of toim. The general luipression 
we gained while in Cincinnati was that the support of the 
building principal for career education is critical to 
its success. Certainly the outstanding programs we saw 
seemed to be traceable to the leadership and determination 
of the principals. It may be that the principal at Aiken 
High School does not yet ^see the value of career education 
Indeed j he may associate career education with vocational 
educations given the sharp split between the academic and 
vocational worlds at his high school* Hopefully, in 
time J the new senior high school career education Coordi- 
nator (who arrived in November of 1975) can introduce 
the elements of career education into the 10th grade. 
However^ the essential elements are SCORE and CO.G.^ both 
of which depend for their success, on the willing parti- 
cipation of classroom teachers. Such willing partlcipa« 
tlon Is^.not very likely in the absence of positive sup- 
port and encouragement by the high school principal* 

Parental participation in career edueation differs con-- 
slderably from school to school* In some schools parents 
serve as members of advisory coTranlttees — either the advi^ 
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moty committees set up specifically for career educa- 
tion or pre^-exlstlng advisory commltteas to which career- 
minded parents and other coTOmunlty representatives have 
bean added* In other cases, parents participate as 
speakers, participate in trips, or help out in other ways. 

On the whole j the Cincinnati Career Development Program 
has not been extremely successful in involving parents 
in its activities. In those cases in which parent In- 
volvement was relatively easy to arouse, the frogram has 
benefited from it. We believe that Increased parent 
involvement is desirable and that the Program staff and 
school personnel should do more to motivate and convince 
the hard-'to--reach parents that career education is not 
only worthwhile but worth their personal participation* 

In-service training has been made available to teachers s 
Instructional Aides ^ and administrators either through 
Coordinator-^led in--serv±ce classes or university-abased 
career education courses and workshops* 

The in-service programs are begining to be very well 
attended and actively sought by classroom teachers and 
by admlnietrators • They should certainly be continued 
andj if possibles eKpanded during the summer of 1976 and 
during the 1976-77 school year. 

The Instructional Aides have been required to attend 
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in-^service sessions throughout 1975*76, We are unable 
to aoimment on the quality and effectivenass of this 
training because we were not able to Interview any In- 
structional Aides, 

The Cincinnati City School District central admnistra^ 
tion has supported the Career Development Program by 
including the staff in major meetings of Instructional 
consultants who work in various subject fields ^ by en- 
couraging good communication between them 5 and more spe-^ 
cificallys by providing for the on-going internal evalu= 
ation of career education endeavors through assigning a 
highly competent Associate in PrograTn Evaluation to it. 
These moves appear to be indications of sincere interest 
by the central administration of the Cincinnati City 
School District in career education 

The Career Development Program has worked during 1975^ 
76 through a management design entitled Manancment By 
Qb.1ectiveB > The plan Is a very sound guide to the Pro-- 
gram staff in determining what it must accomplish by 
what points in time and is an equally sound device for 
monitoring their work. We conmieiid the staff for using 
this management design seriously and for keeping on 
schedule and meeting all stated objectives. 
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The Cincinnati career education administrative staff is small 
but efficient. The leadership of the Program director herself Is 
a key factor in their success. The director is very knowledgeable 
about career education and Is %*ell aware of the Instructional situ- 
ation in each of the school buildings. We found clear evidence 
that she maintains excellent rapport with the individuals we 
interviewed. There is a decidedly good working relationship be- 
tween her and teachers, counselors, and administrators in all the 
buildings we visited. 

The director ia ably assisted by two Coordinators who serve 

I 

as direct links with the schools. Inasmuch as the 1975-7^r school 
year is now winding down. It TQay not be necessary to fill the 
vacant position formerly occupied by a third Coordinator. But we 
feel that at least one Coordinator Is needed for grades K-6, another 
for grades 7-8, and another for grades 9-10. Certainly, given 
what we have observed earlier about the situation in the 9th grade 
and 10th grade, the need for two Coordinators for grades 7-10 is 
apparent. Adding a third Coordinator would of course facilitate 
more frequent personal contact between the Program staff and indi- 
vidual classroom teachers. 

Finally, as we pointed out earlier, the elementary and junior 
high programs are working well, but the senior high program leaves 
much to be desired, ~' 
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This report contains the results of the observations of the 
Career Development Program by PSE personnel In the Cleveland City 
Sahool District on March 11th and 12th, 1976. A total of six 
pereoii/days of iuch observations underlie this report. 

The criteria used as the basis for this evaluation were the 
process objectives stated in the Cleveland Career Development 
Frogram proposal. 

During the observations carried out for this evaluation ^ we 
visited the Cleveland City School District administration building, 
Glenville High School, its three "feeder" junior high schools, and 
three of the 14 "feeder" elementary schools in the Glenville at= 
tendance area. We conducted interviews with school administrators , 
career development Coordinators, teachers, and students. Classrooms 
were observed, .Curriculum guides were reviewed and a variety of 
instructional materials were examined. 

The Program director or a representative from the Program staff 
accompanied us to all of the buildings, and we were Joined on the 
second day by Ohio's state director of career education. Travel 
time between the different schools was used to share with the 
local and state officials many of our observations and conclusions 
regarding Cleveland's Career Development Program, A conference 
was held with the Program director and Program staff at the close 
of the final day of observations p This report includes much of 
what was stated either directly to the local and state officials 
or in the meeting with the Program staff. 
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Co nclusions 

The Glanville area (approximately 12 ,000 studants) is in 
its final year of the Federal Vocational Education Act 
Part D funding as a state- ponsored Program In Career 
Education* It was organiged and is operated under the 
direction of the Division of Tdchnlcal^Vocational Educa- 
tion of the Cleveland City School District* 

To data the prograni has been very successful In incorpor^ 
ating the Career Development Program into the eKisting 
school atructure so that it will persist beyond the end 
of the VEA Part D funding* The Program director feels 
very confident that career education has become a per- 
manent part of the Cleveland City School^ District curri- 
culum and our o\m observations confirm that confidence. 

Indeed s it is commendable that career education has al- 
ready begun to move outside the Glenvllle area into 
other sectors of Cleveland. The Program staff already 
has been called on to offer In-^service trainiiig to 
faculties in other schools. 

The Program director is assisted by eleven career ed- 
ucation Coordinators (seven in the fourteen elementary 
schools and one in each of the four secondary schools). 
Each Coordinator has an office or a resource room in 
each o'f the- buildings that he or she serves as career 
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Some of the elementary Coordinators not only provide 
services and information to teachers about career educa- 
tion but are also available to demonstrate career teach- 
ing or to assist in career teaching* 

The Motivation program appears to have a well-rounded 
structure involving all of the seven developtnental areas 
such that each child at each grade Is exposed to all 
seven of the areas throughout the year* 

In most eases J practices that have proven successful In 
individual classrooms are shared with other teachers via 
a newsletter that is produced by the building career 
Coordinator. These newsletters are pleasant to read and 
appear to be a good way of motivatliig the not^too-^interes 
ted teacher into career education* ' 

In grades 7-8, interviews and observations revealed ex-^ 
tensive Career Development Program staff Involvement and 
the presence of numerous career development activities 
In the classes* Students are given an opportunity to 
Investigate careers related to their own interests* 
Curriculum units have been changed to emphasize careers 
and how those curriculum units are related to the USOE 
career clusters, ' 
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Along with their role as career education leaders, the 
Coordinators assist the teachers in their individual 
schools by soliciting field trip visitation sites | 
developing field trip, assembly, and visitation schedules 
planning assembly programs; and providing liaison be- 
tween school staff J administrators, counselors, and 
other teachers" in arranging and constructing program 
activities* These services to the teachers have been 
well received and are well spoken of by* the teachers we 
interviewed during our observations* 

The Coordinators have also been instrumental in incor- 
porating career education into the eKieting curriculum 
for the Cleveland City School District j especially in 
the elementary grades. They have developed along with 
teachers and department chairpersons sarnple curriculum 
materials and teaching units Infusing career content 
Into various subject fields. 

In grades K-6s interviews and observations revealed a 
great number of classroom activities. Students are 
being taught positive attitudes about work, tovmrd 
themselves, and toward others through the infusion of 
career motivation activities into variouo subject orGas, 

The elementary school career education resource rooms 
are used actively and vjell, ^ 
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education Coordinatori These offices or resource rooms 
serve as a good tool for signifying the Importance of 
career education in each building and making It easier 
for teachers and students to locate inforniatlon and 
obtain advice. The school administration has shown 
strong support for career education by providing class-- 
rooms or office space for Coordinators in each of the 
buildings . 

The Program Coordinators have been very successful in 
TO^'tlng the process objectives of Cleveland's Program 
proposal. The majority of the Coordinators have been 
with the program sinffe its inception and possess a 
thorough knowledge of career oducation and how to imi^le^ 
ment it in a school system. These Coordinators have 
taken on a leadership role by providing required in-^ 
service training a number of times each year to the 
teachers in their particular school buildings. The in-- 
service training is voluntary for the teachers and has 
been very successful in all three levels (Motivation p 
Orientation and Exploration) , Many of the Coordinators 
are recognized throughout the community as eKperts in 
career education, " Some are called on to serve on com^- 
mlttees or to speak at functions outside of the Oleriville 
area* 



It is evident that the business and industrial com- 
munity in Cleveland ±^ supporting the Career DevGlopment 
Erogram in the junior high schools. Speakers visit class-- 
rooms and talk with students about careers and the worid— 
©f work. At least one of the junior highs had its career 
day in which members of the business coiranunlty came to 
the school and talked with small groups of students 
about their various careers* This seems to have been 
well received by students j parents , teachers i as well as 
the business coimnunity. 

\ 

Although not every tcnchcr on the 7th and 8th g^ade level 
is thoroughly involvod in career educations those teachers,,^ 
we observed were conducting career education activities 
of a very sophisticated nature. 

On the junior high levels *career education may not have 
developed to the point v;here it can be said that each 
student on the 7th and 8th grade level is receiving an 
equal amount of career education across all seven deve- 
lopmental areas. It la not easy to get junior high school 
teachers involved with career education* Possibly 
special efforts should be made to provide more in--depth 
in-service* Also, the possibility of having the guidance 
counselrra impart career information to students is worth 
explorint. 
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In gTadei interviews and observations revealed 

a very eKtensive involvement In the Career Development 
program by staff and administrf tors* It was evident 
that the majority of the teachers are involved in career 
education. The career exploration Coordinator could 
walk down the hall and tap any teacher on the shoulder 
and ask if there were any career education going on in 
his or her class that the visitors could observe. Very 
few teachers comaented that nothing was going on in 
their classes at that particular time. It would be 
safe to say that almost every lOth grade student is 
receiving career education in most of his or her classes, 
no matter what course of study he or she is enrolled in, 

A close relationship between the business/industry com-- 
munlty and the school was in evidence* Many field trips 
are conducted and many speakers are used* Cleveland 
has a wealth of business/industry opportunities readily 
available and it appears that GlenvillQ is fully using 
as many of these as possible* Glenville has no trouble 
in providing "hands--on" experiences for as many students 
as want them* 

The guidance department appears to be receptive to the 
Career Development Program. Counselors use the Ohio 
Vocational Interest Survey (OVIS) and the General Appitude 



Test Battery (GATB) with students In the eKploratlon 
prngram. Positive attitudes about self and work ar^ 
developed and/or reinforced through Individual and 
group counseling sessions. 

The career education offerings in the instructional media 
section of the library have been increased. Moreover i 
the students use them. 

Current occupational information is made available to the 
student3"in newspapers ^ leaflets , facts sheets ^ etc, in 
the career education office, A student siinply has to walk 
in and pick up the information that he or she desires* 

Career Development Advisory Committees have been set up 
and are used, but parents are not as involved as the 
school personnel would like them to be. Even though 
there is a lack of parental participations the school 
principals and Coordinators express the feeling that 
the parents are increasingly in agreement with the 
purposes of career educations now that they understand 
them. Many college-^oriented parents were resistant to 
the seemingly "vocational education" emphasis at firsts 
but there is now evidence that they are less sceptical 
and are even somewhat appreciative of the school's 
effort to make education more meaningful for their 
children. Students are sharing their occupational idoas 
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with their parents and are seeking direction froni the 
achoQl as to what activities would be appropriate to 
learn more about their fields of interest* 

In eontrast^ business and industry Involvement In com^ 
mittees and other activities ii excellent. 

Curriculum development by teachers and department chalr^ 
persons with the assistance of career education Coordin- 
ators has proceeded very well* Some teachers are still 
slow to try the new curricula and materials, but the 
number has decreased remarkably since the beginning of 
the current school year. 

The Cleveland City School District adminiatration has 
been not only support Ive but instrumental in Implementing 
the Career Development Program in the Glenville attendance 
area. The Program director has been able to move across 
curriculum boundaries and grade levels freely. Consulta- 
tion services are provided by the school district's 
guidance and subject matter supervisors. The Director of 
the Division of Technicals-Vocational Education eKpressed 
his full support of the program and views it as a new 
and valuable addition to local instructional efforts- The 
Superintendent includes stateTnents about career education 
In many of his addresses to groups and in his weekly 
bulletin to district personnel. Public records are 
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available which ^dLll show the kinds and numbers of 
business and industry involvement with the Glsnville 
area schools. The district's Division of Rasearch and 
Development is responsible for and fully used In the 
internal evaluation of the program* 

The Career Development Program staff Is confident , efficient, 
hard-working, and very productive. They have given superb guidance 
to the educators in their area and have done an excellent Job of 
motivating them toward good career education efforts* 

All of them are communicating very effectively with members 
of the community v7hose daily work is outside the sphere of formal 
education. The combined efforts of the staff and concerned citizens 
are aiding in the orientation of the Glenville area students to the 
world of work through education. 

The career education Coordinators, along with the Program dir- 
ector and their colleagues, are to be commended for the eKcellent 
manner in which they are fulfilling the objectives of the Cle\*eland 
proposal. Through their experiences, they have developed a great 
amount of expertise that we hope will be fully recogiiiEed and used 
as Career Development Programs are begun in other areas In Cleveland. 
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Thl^^ report contains the rasults of the obsarvations of the 
Career Development Program by PSE personnel in the Springfield 
City School District on >Iarch 17th and 18th, 1976 • A total of 
six person/days of such observations underlie this report. 

The criteria used as the basis for this evaluation were the 
urogram objectives and the description of planned activities 
stated in the proposal entitled: Hareer Motivation, Orientation, 
and Exploration; an Ohio Career Devel opment Program^ submitted 
to the Ohio Department of Education Career Development Program. 

During the observations carried out for this evaluation , we 
visited the Springfield City School District administration build- 
ing, South High School, two of its five "feeder" Junior high 
schools, nnd two of its ten "sending" elementary schools. We 
conducted interviews with school administrators , career education 
Coordinators, teachers ^ counselors , and students. We also observci 
instructional activities in classrooms, Wa eKamined curriculum 
guides and a variety of instructional materials. 

We held a closing conference with the Program director at 
the close of the final day of observations. This report includes 
much of what we said to the director during that closing session. 

Chief Conclusions 

1. In the Springfield City School District, the South High 
school attendance area (approKimately PjAOO students) 
is in its final year of the Federal Vocational Education 
Act Part D Funding as a state^sponsored program in career 
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education. As a rasults both the project staff and the 
school official to whom they report^^-'the Director of Cur-- 
riculum and Instruc tion^-^have been giving attention to 
how the program can be continued during 1976=77 and beyond. 

Two possibilities are open to thein. The first is that 
additional Federal funds can be obtained from some source 
to continue career educations perhaps with emphasis cm 
a special population such as the gifted or perhaps embed-- 
ded in some other aspect of tha curriculmi such as consumer 
education* Accordinglyi both .the career education Program 
Director and the Director of Curriculum and Instruction 
have prepared proposals soliciting Federal funds. 

The second possibility is thatj in the event outside funds 
cannot be obtained, career education can ba continued 
with support from the Springfiald Board of Education* 
Accordingly^ the local officials responsible for career 
education have bean working to incorporate career objec- 
tives Into the present instructional program and to absorb 
career personnel into the regular school staff* As a 
part of this endeavor, an attempt is being made to correct 
some of the existing weaknesses in career education. 

Both the rrogram Director and the Director of Curriculum 
and Instruction d lerve to be commended for looking well 
ahead to 1976-77 and seeking to malntaiii career education 
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in one way or another. 

The Program director is assisted by eight Program Co*- 
ordinators. All but one of the Coordinators are housed 
in the main career aducation offices which is located 
in the Springfield City School District administration 
building. One person— the Coordinator responsible for 
the 10th grade exploration program--is housed in South 
High School* 

The fact that seven of the eight Coordinators are lo^ 
cated in the administration building limits their ac-- 
cessibility to the teachers they service in the indi-- 
vidual schools. In most cases, the Coordinators have 
designated certain days when they will be in each build- 
ing and have made a genuine attempt to see as many 
teachers as possible during that scheduled day. Never- 
theless ^ a few teachers indicated that they did not 
see their building Coordinator as often as they should. 
But teachers who expressed that opinion were willing to 
accept partial blame for this situation in that they did 
not often seek out the help of their Coordinator. 

The Coordinators themselves appeared to be satisfied 
with the locations of their offices and seemed to be 
willing to take the extra time required to drive from 
their offices to a school and from one school to another 
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We believe that It is important for Coordinators to be 
located in or very close to the school buildings they 
serve. The incidental contact with teachers ^ counselors, 
librarians, principals , and paraprof essionals—at a 
coffee break, at lunch ^ in a few momenta before school 
or after school ^ before^ during, or after faculty meet*- 
ings, while driving together to and from school, and so 
one—provide opportunities for informal, often unplanned, 
but nevertheless significant comiunicacion* The personal 
relationships as well as the idea exchange that ^akes 
place under those circumstances are advantageous for the 
expansion of career education* 

We understand, of coursej that the Coordinators need to 
COCTnunicate with each other and with the Director to 
exchange ideas and to plan and coordinate their work. 
However, we believe that periodic meetings=^perhaps every 
week or two — would be sufficient for this purpose. More"- 
over^ if such meetings were scheduled after regular class^^ 
room hours~say from 3iO0 pwm, to 5^00 p*m*~they would 
not separate the CDordinators from the teachers in their 
buildings * 

For all these reasons , we recomnend that each Coordinator 
be housed in one of the schools he or she serves. 

Each of the eight Coordinators has special strengths 
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that are well used in the Career Development Program as 
well as in the overall program of the Springfiald City 
Sehool District. Some of the Coordinators are especially 
skillful in in^"service education; another has good organi-^ 
zational abilities; another has a background in psychology 
another is particularly effective in working with people; 
others are good at curriculum development* We mention 
the Coordinators in some detail because they are the 
backbone of the Progr n and because the majority of the 
funds go for their salaries and their activities. We 
found most — but not all--^of the Coordinators to effec-- 
tive and productive- 

As a part of an internal evaluation study, the Springs- 
field Program staff surveyed teachers, asking them to 
conmient on the amount of career knowledge they possessed ^ 
the degree to which they had incorporated career educa^ 
tion into their curricula, and the type of training they 
needed and wanted* 'Tfte results indicated that over 80 
percent of the teachers are involved to some degree in 
career education and that most of them want further In- 
forination about it* 

In our interviews with the teachers, some of them ex- 
pressed the desire for more personal contact with the 
Coordinators, They did not ask that in-service training 
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be eliminated s but simply that the Coordinators be more 
avallabla to work with them individually in applying 
career education in their o\m classrooms. We recQgnlge 
the economies of scale available through training teachers 
in groups and we recognise the benefits of having teachers 
exchange Ideas at such sessions* But our own experience 
has been that individual contact is the most influential 
way of dealing with teachers—just as it is with students. 
Individual contact at the teacher's convenience and di- 
rected to his or her specific need for ideas or materials 
or assistance in arranging for trips and speakers is the 
most ef f ^^t^^^^fehnique a Coordinator can use. It is 
particularly helpful as a follow=up for group in-service 
training sessions. 

The Program staff has begun to use the information obtained 
from the survey in determining the content of in-service 
sessions conducted by individual Coordinators for indivi- 
dual buildings. In some cases the Coordinator has pre- 
sented career education ideas and materials at general- 
purpose teachers' meetings. (A number of teachers pointed 
out they had become more aware of career education through 
what Coordinators had said at general meetings 5 even 
though they had not attended any in--scrvice sessions,) 
This see- to be ^a' good way to make teachers aware of 
career materials and services available from the Coordinator 
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It seemed quite clear from our interviews with teachers 
as well as from the results of the survey conducted by 
the Program staff that teachers in the Sprinofield City 
School District are quite receptive to the purposes of 
the Career Development Program and are looking to the 
Coordinators for leadershipp instruction, and assistance. 

In grades our interviews and observations revealed 

that the curriculum has been designed to incorporate 
activities which are related to the seven developmental 
areas In the Ohio Program, Career motivation Is evident ^ 
particularly In special units prepared by classroom 
teachers* Moreover, successful classroom practices are 
being shared between teachers* It is quite beneficial 
for teachers to share successful classroom practices; new 
methods and new materials do not seem quite as foreign 
when someone In whose judgment a teacher has confidence 
relates how successful they have been in that person's 
classroom. 

The CQOrdinators deserve to be coimnended for scheduling 
special workshops in individual schools* sometimes at 
individual grade levels y In response to specific requests 
for information and help. These tailored workshops for 
small groups of teachers with focused interests are a 
good supplement to and quite possibly are more bene- 
ficial than larger, general-purj)Ose meetings and work-- 
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shops dealing with career aducation* Their efflciancy 
lies, of course^ in the fact that the information pre- 
aanted can be targeted to the audience and that all 
members of the audience can use most of what is said. 
They also offer an eKcellent chance for the enthusiastic 
endorsement of career education by one teacher to affect 
the attitudes of other teachers, since the entire group 
is working in the same school building, and perlinps at 
the same grade level 5 under the same general conditions 
with the same kinds of students. Thus the testimony of 
a teacher can be quite influential on the views of other 
teachers similarly situated # 

5* In grades 7^8 our interviews and observations Indicated 
that the Career Orientation Program relies not only on 
classroom teacher participation but also on a one«semester 
course called Values and Decision^FEking at the 7th grade 
level and a one^semester called Careers and Society at 
the 8th grade level • Having two seperate courses offered 
to all 7th and 8th grade students insures that every 7th 
and 8th grade student will receive a certain amount of 
career education during the Junior high school years* 

There is, of course, a risk in ihls kind of special 
scheduling of career instruction. It can provide regu-^ 
lar classroom teachers with an excuse for not'lncorpo- 
rating career content into their curricula. They can 
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eafiiy say that career education is being taught in 
specially^scheduled classes and that it is not their 
rasponsibility . Thus it is particulariy important in 
a program that uses this type of scheduling that the 
Coordinator serves all teachers in the building, not 
just the "career education teachers'* responsible for 
those special classes. In one of the Sprinofield 300- 
ior high schools, the Coordinator is clearl^^ reaching 
most of the teachers. In the other, ic is not so evi- 
dent. 

Since the CoordinatDrs are not housed in the junior 
high schools one advantage of having these special 
''career education teachers" is that they can serve as 
Internal ^spokesmen for career education in faculty 
meetings j in the teachers* lounge , and around the lunch 
table. 

Most guidance counselors in the two junior high schools 
work very closely with the Career Orientation efforts of 
the teachers and the Coordinatdrs * Thi's is quite bene- 
flcial in that the guidance counselors are soinewhat more 
accessible to the teachers^^and to the students, of 
course^-^than the Coordinators themselves can be* 

The libraries contain career information that may be 
used by students on their own initiative but is more 



88 



likely to be used by studGnts under the direction of a 
classroom teachGr. That is, at present, most students 
do not have the niaturity to initiate their own career 
research projects without teacher guidance. 

The principals of both the junior high schools were very 
conversant v;ith career education and were quite willing 
to see it implemented in their schools- It has been 
our observation in visiting many career education pro-- 
grams nationwide that the leadership and support of the 
building principal is virtually decisive in detarminlng 
whether career education will be. successful* The Program 
director and the Coordinators in Springfield deserve to 
be commended for leading the school principals to give 
positive support for career education* 

Support from the business coTrnnunity surrounding the 
schools is also assential for the success of career edu-- 
cation. It was evident that bQth.4&^^^^ high schools 
have been able to arouse the support of the business 
community in stiifiUlating business leaders to speak at 
school functions 5 to open their stores and plants to 
students for field trips , and to supply relevant and 
pertinent inf omiation for students about the career 
areas in which they conduct their business* Again, the 
airector arid the Coordinators 3 along with the junior . 
high school principals and teachers, deseryift 



anded for this achievement. 

In grades our Interviews and observations revealed 

that a eoncentrated effort is being made to provide 9th 
and 10th grade atudents with at least one if not three 
"hands-on*' experiences . 

A computer terminal is located in the high school and is 
used to aid 10th grade students in expressing Job pre^ 
ferences and thus in locating settings in which they will 
have experiences. 

The use of the coinputer appears to be an excellent means 
not only for expediting the process but also of motivating 
students to choose a "hands-on" experience*^ The Springs 
field City School District appears to be very close to 
its objective of providing at least one "hands-on" exper^ 
ience for all 10th grade students* 

The Ohio Vocational Interest Survey (OVIS) is used by 
9th grade counselors to help all students assess their 
interests, but Springfield personnel consider the OVIS 
reading level to be too high for many 9th grade students. 
However 3 we got no indication that the Career Develops 
ment Program staff was doing anything currently to modify 
this situation J as by seeking an alternative to OVIS. 

Although many of the 9th grade and 10th grade teachers 



wa interviewed spoke favorably about career education 
and many of them ^ere able to mention some career actl-- 
vity they had conducted in the pasti most teachers were 
not able to point to a current or recent classroom acti- 
vity dealing with careers. 

The Coordinator has chosen to work with the various 
academic and non^academic departments to introduce 
career concerns into the high school rather than work- 
ing with Individual teachers* He has been most success- 
ful in using this approach with the English department ^ 
in which all 10th grade students this year are being 
provided the experience of making a job analysis under 
the direction of their English teachers. 

Given the favorable expressions about career education 
Blade by the . individual teachers we interviewed—teachers 
in departments other than English, lncidentally~we 
believe that the Coordinator would meet b if^t.^-ss in work^ 
ing with individual teachers in other departments ^ even 
though an entire department may not yet be ready to 
embrace career education * Given the autonomy of Indl-- 
vidual classroom teachers , despite their allegiance to 
their Q%m academic and non=academlc departments^ we can 
believe that a "broken front" approach in which some 
teachers moved out ahead of others might be effective. 

/ ■ 
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Throughout grades K-^IO, the Coordinators are doing a 
generally good job of assisting teachers through formal 
in-service training programs and, to a lesser degree , 
through individual contacts • The Coordinators not only 
perform a leadership role, as by giving in--service train-- 
ingi but also perform a service role as by procuring 
materials and supplies for teachers as well as by arrange 
ing schedules for field trips and on-site explorations* 

The acceptance of the Coordinators as specialists in 
fields outside of career education as well as within 
career education has enabled the Program to be repre-- 
sented on a number of district^wide conmiitties crncerned 
with curriculum modification and textbook selection* 

The Coordinators s as indicated earlier ^ have been in- 
volved in the internal evaluation of the Program by 
administering survey instruments to determine teachers' 
attitudes and needs and by engaging in analyExng the ■ 
survey results as a means of determining the effective- 
ness of their work* 

The Program director is highly regarded by those whom 
we interviewed. His Judgment is respected and his raport 
with his own staff and with administrative personnel both 
in the central office and in the individual buildings is 
quite good . 
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The director has shared information about the Spring- 
field Career Development Program with interested educa- 
tors throughout Ohio and. Indeed, throughout the United 
States, That information has served as foundation 
material for a number of other school districts in im- 
plamanting, their own career education programs, 

9. The Director of Curriculum and Instruction expressed 
his full support for the program in his conversations 
with us and his satisfaction with the administrative 
techniques of the Program director and with the work of 
the Coordinators* 

Generally, the Springfield City School District Career Develop-' 
ment Program is doing a good Job in meeting its stated objectives. 
The Program staff is doing a good job In helping teachers incorpo^ 
rate the spirit and content of career education into their class- 
room activities. School administrators have indicated their belief 
in the ir^portance of the career education movement. On the whole^ 
the atmosphere for career education in Springfield seems to be ^^^^^^ 
quite favorable* 

The Program staff is composed of knowledgeable i personable, 
hard-working individuals. Any small group of people working to- 
gether usually reflects its leadership, and this one is no except 
tlon. The Program director is a sincere, hard-working and especiolly 
productive person with a genuine IntGrest in education and its role 
in preparing students for the world of work. 
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APPENDIX 2 
PRE--TEST / POST^TEST FINDINGS FOR 
INDIVIDUAL CITIES 
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Findings for C incinnati 

As mentioned above, the resurts for each test administration were 
reported by item, by developmental arQa groupings ^ and by total cognitivQ 
or affecti%^e test scores for each city, each grade, and each student group, 
The findings for Cincinnati are displayed in thn data analysis tables 
appearing in the text or in the Appendix, (The pre-test data and post-test 

data appear in AppendlK 2.) 

The following sections will describe the pre-tcst/post-test changes, 
that occurred in each grades as well as changes that occurred in various 
student groups. 

Student Characteristics , As was noted in Table 2 of the Proccduros 
section, the pre--test was administered to I3A91 prooram students and 434 
non-prograni students, while the post-^test was administered to 1,291 progrntii 
students and 429 non^program students* The number of program students 
participating in both the pre-teRt and the post-tesu was sufficient to 
represent the prograiTi at the various grade levels. Likewise, the nuuiber 
of non-^prcgrani students conipared to program students for both tost adminis- 
tration was large enough at each grade level for various comparisons to 
bf made* 

For each test administrationi the distribution of prograTii students 
and non-program students at each grade level appears In Table 4* For both 
the pre=-test and the post^ tests the program and non-program populations 
contained approxlm.at ely an even division betv;een boys and girls at each 
grade level. Also, for both tost administrations, the program population 
contains approximately 55% Black and other students and 45% white students 
at each grade level. The non-prograni population, on the otlier hand, con-- 
tains approxiciately 65% Black and other students and 35% white students 
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Program and Non-Progi.im 
Student Charac tori sties 
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at the third grade level, 30% Black and other students and 70% whita 
atudents at the sixth grade level,, and 80% Black and other students and 
20% white students at the eighth and tenth grade levels. Both the tenth 
grade program and non-program student populations are made up of approx- 
Jjnately 30% students enrolled in an academic curriculum and 70% students 
enrolled in a non-academic curriculum* 

For the various analyses which were run; sample size was considered 
when computing the "t" value* Based on the data appearing in Table 4 
and the information supplied by the program director concerning compara- 
bility * the overall program and non-program groups seem to be as comparable 
as we would hope to find. 

Overall R esults. The overall results for the cognitive and affective 
tests for both the pre=test and the post'-test appear in Table 5, The 
overall results for both the cognitive and affective tests indicate that at 
most grade levels the program students started the year with a better 
understanding of careers-related concepts and slightly better attitudes 
towards' these concepts than the non-^program students. In grades 3 and ID 5 
the difference between programlnd non-^program scores on both the cognitivu 
and affective tests was statistically significant and indicates that the 
program students had a definite advantage over the non--program students 
in October, 

The post-test results on the cognitive test indicate that the students 
in grades 3 and 8 ended the year knowing significantly more career concepts 
than their non-program counterparts. The sixth grade program students 
also comploted' the year knov?ing somevrhat more than the non-program students, 
although the difference between the program score and the non-program score 

* 
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Table 5 

Percent of Items Anstyerod Correctly 
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is not as significant as the differences for grades 3 and 8. These results 
reveal that not oiily did tho prograTO students start the year with an advan^ 
tag© ©ver the non-program studants, but they were able to maintain that 
advantage and finish the yQar'L^iB^l.ffTy±^g^%jtB knowledge of career education 
concepts than their non--pro£:;L am n^^tches. 

Although the program students in grade 10 began the year knowing con- 
siderably more their non-prograTn matches^ they were unable to inaintain this 
advantage and to finish the year with significantly higher scores. Instead j 
the program students' sccre was considerably lower than the non-program students 
The non^program students in grade 10 ended the year slightly behind where 
the program students had begun the year. This indicates that the Information 
the program students had received prior to beginning tenth grade placed 
them approximately a year ahead of their non^program counterparts , but 
that during the tenth grade year the non-program students were able to 
catch up and actually score higher on the post^test than the program students* 

Similar to the results for the cognitive tests the post-test results 
for the affective test indicate that the students in grades 3, 6, and 8 
not only began the year with slightly better attitudes than their non- 
program counterparts s but also ended the year displaying slightly more 
favorable attitudes than their non-program matches. The most signi- 
ficant difference occurs in grade 3, where the program stt/dents' score 
was thirteen points higher than the non-program students* score. As was 
the case with the cognitive tests the tenth grade program students began 
the year with significantly more favorable attitudes towards ca.^eer educa- 
tion than the non-program students but were unable to keep their advan- 
tage. The non-program students' attitudes changed considerably during 
the year J and their score on the post-test was considerably higher than the 



' . program students*. The results for the non--program students on the affactive 
test are not surprlsins in that as' these students gained career awareness (as 
evidenced in the cognitive tost results), it would be expected that their 
attitudes would be influenced also. 

In general, the Cinclr.nnti Career Development Prograin has been very 
successful in impleinQntini: a career development progi ara for students in 
grades 3, 6^ and 8 that can display measureable difference in learring 
betv7een progrr4in and non^-proorari students. Unfortunately, the program has 
not been as successful in thd^ tenth grade and future program efforts would 
have to be directed tDv;ards this grade level. 

Res\ilts for Devcf lopn^on i:rl Areas . As mentioned earlier ^ the results 
of the cognitive and affective testis were also analyEed by developmental 
areas* The number of items in each developmental area was presented in 
Table 1 of the Procedures section* The number of items in each develop- 
mental area differed at each grade level. \sTien looking at the results 
from both the pre-test and the post--test at each grade level, the develop- 
mental areas can be . ranked by "t" values to show areas in which the program 
students showed superior knowledge or attitude ("t" values above 1*65); 
to show areas where the progi^am and non-progriim students were equally 
informed ("t" values from --1,65 to +1.65) ; and finally ^ to show areas 
in which the non^progrnm students showed superior kiiowledge or attitudes 
C"t" values above -1,65). 

The results from the third grade pre-test indicate that the program 
students began the year with, superior knowledge in all seven of the develop- 
mental areas on either tlie cognitive or affective test* As the year pro- 
gressed * the program students in grade 3 were also able to maintain their 
euperiority. The May post--tGDt results show that the program students 
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were &ble to obtain statistically significant scores in all seven of the 
developmental areas. These results Indicate that not only did the program 
students hegln the year knowing considerably more than their non^program 
matches^ but that the instruction they received during the year was consi- 
derably different from that received by the non-program students. Conse- 
quently, the third grade program students were able to receive scores on 
the Hay post^test that were considerably different from those received by 
the non-program students. 

The pre'-test results for the si?:th grade indicate that although the 
program students were able to answer questions in all seven of the develop- 
mental areas on either the cognitive or the affective test^ they did not 
possess superior knowledge or attitudes in any of these areas* The results 
for the cognitive test indicate that possibly the areas of Individual and 
Environment, Employabilit> and Work Adjustment Skills * and Decision-Mnklng 
were weak areas during the October testing. Likewisej the affective test 
suggests that the areas of Individual and Environraent , Employability and \%ork 
Adjustment Skills, Self, and possibly Decision-Making arc also weak areas 
'for affective learning prior to the beginning of the sixth grade year. 

Through instruction and activities during the school years the progrnm 
students were able to obtain sufficient career information to enable them 
to show slightly more knowledge in six of the seven developmental areas on 
the May post-test. The greatest difference was shown in the area of Wbrld 
of Work where the program students received an overall score that was strvtis- 
tlcally significant over the non-program students' score. The weakest area 
was Declsion=Making where the program students' scora was slightly lower than 
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the nQn-program students' score. The results fur the affective section of 
the post-test do not display the same g.^ins that the caanltive test results 
showed. Although program students were able to score slightly better than 
non^program students in four of the developmental areas ^ they were unable 
to score higher than the non-program students in the areas of Eiriployability 
and Work Adjustment Skills and Self* 

Whereas the program was able to supply its students with information and 
experiences in inost of the seven developmental areaR, future program efforts 
should nonetheless continue to st s all the developmantnX areas and assure 
that each student receives instruction or eKporiences that relate to each of 
these areas* The program appears to be making a good atLcmpt in prcGenting all 
seven developmental areas in a cognitive and affective manner and, possibly, 
by intensifying its efforts, it can also increase program scores. 

The eighth arade results for developmental areas indicate that althDugh 
the program students began the year at a slight disadvantage when compared 
to non^program students on the cognit've test, the instruction they received 
throughout the year enabled them to achieve considerably higher scores than 
their non^program m.atches in all seven of the developmental areas by the end 
of that year. The cognitive results for the post^test clcarl^ demonstrate 
that the program had made an impact on its students in all seven of the 
developmental areas. 

The changes that occurred in attitudes of program and non^program 
students over the year are not as dramatic as the changes in cognitive 
learning* The program students began the year with a slight advantage 
over thiir non-program Tnatches and ended the year with a sllglitly greater 
advantage. The strongest area for the affective results is Economics* 
In this area, the program students began the year with oiightly less 



positive attitudes than their non-program counterparts ^ yet they completed the 
year displaying considerably more favorable attitudes to concepta relating 
to Economics than their non^program Tnatches* 

The pre--test/pos t-tes t analysis for this grade level indicates that 
the program has made a cdnsiderable impact on its students. The instruction 
received by the students and the activities in %v?hich they participated were 
sufficient enough to enable them to score higlier than students who had not 
had the opportunity to participate in c^he program* The program was sQFiev;hnt 
more successful in changing the cognitive learning of its students than 
the affective learning* Future program efforts should continue in pi:asenting 
a weli--rounded program of career education concepts with some consideration 
being given to eKperiences and activities that would influence students' 
attitudes to a larger extent, 

" The results for the developmencal areas on the tenth grad^ pre^test 
Indicate that the program students begnn the year ; novring considerably 
inore than their non--program counterparts in five of the seven developmental 
areas and displaying significantly' better attitudes towards the concepts 
presented in all seven of the developmental areas* This indicates that 
the program j prior to the tenth grndOs had given its students a clear advantage 
' over their non-program counterparts* However 5 the tenth grade program was not 
able to add to its stud ants' knowledge and attitudes in the course of the year. 
Instead 5 the non-progr£._ students were able to catch up to the program 
students and to surpass them in all seve. of the developmental areas on 
both the cognitive and affective tests in the May post--test* Our visits 
to the Cincinnati school district indicated that the tenth grade was the 
weakast area in the program^ and these test results confirm our observa^ 
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'tlons* Future program efforts should definitely be directed towards 
SsO' reach irig the tenth grade students *with more career**relatad InfDrmatiQn 
i-v^land experiences that would influGnca t^^^ cpgnitive and affective laErning 
Ui^ of the students at this grade level 

- 

fS",-^' Results for Boys and Girls . The results for both the cognitive and 



affective tests were also analyzed to locate differences between, program 



t 

boys and non-program boya and also program girls and non^program girls. 

r% The overall results for the cognitive and affective tests at each grade 

;ir level. -for both test administrations appear in Table 6* 
rr The pra--test results indicate that both program boys and program 

y girls began the year with an equal knowledge of career education concepts 

1 ' and^aqually positive attitudes towards these concepts* This Implies that 

i inethods of instruction and activities provided by the program could be 



f - equally received by program boys and progft.sffl....girls and that neither group 
had an advantage over the other group at the beginning of the schc/ol year* 

V- The post^test results showed that the program made its greatest impact 

on the cognitive and affective learning of both program groups at the third 
grade level* Both program boys and prograin girls received significantly 
higher scores on the cognitlva and affective tests than their non^program 

/ third grade matches* 

I/- The post=test results for grades 6 and 8 show that although the pro- 

: gram, students in both groups were able to score slightly higher than their 

. , non-'program matdhes in the cognitive test, the difference between program 
: ando^Urpr^g^srs scores was not large enough to be considered statistically 
significant. This indicates that to the extent that the program is in- 
fluencing the cognitive learning of its students at these de levels, 
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Tabic 6 
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fe^-lt ±e influencing both groups equally, 

lli;;,! The results for the tenth grade cognitive test show that although 

y-- both program groups began the year with a definite advantaga over their 



Mil; 



tip 



W^' n©n--program matchesj neither group was able to maintain this lead and end 

li/;.^^- - ^ ■■ ■ - ' . ^- . 

li^- the year showing signifitant gains . Therefore ^ we can say that neither 
group benefitted from program efforts* 

The affective results for the post-'test sX grade 6 show that both 
program and non^program boys and girls ended the year with relatively the 
" same attitudes* Apparentlys the program had not influenced the attitudes 
H of either program boys or program girls to any large extent at this grade 
i level. The post-test affective results for the eighth grade phow that 
i" both program boys and program girls hold somewhat better attitudes than 

their non-^progratn matches and have benefitted equally from program exper- 
r- - ■ iences which influence attitudes. The tenth grade affectlvo results ore 

elmilar to the cognitive results and do not show that the program has 
'/ influenced the attitudes of program boys or program girls to any extent, 
V In general* in grade levels where the program has made an impact on 

:- :^lt a students. It has influenced the learning of both program boys and 
program girls equally. 

Results for Black and Other Students and ^^niite Students . The pre- 
Ji'^^...^test and post-test data were also analysed to determine if the program 

had had more effect on cither of these two demographic groups. The results 
this analysis appear in Table 7 . 
ri. . The pre-test results indicate that in October both program groups 

t had a alight advantage over their non-program counterparts in cognitive learning 
at every grade level, with the eKception of the eighth grade Black and 
other program students* In grades 3 and 10, the affective pre-test results 

106 , - 

EKLC 



Table 7 



Percefit of Items Answarad Correetly by Black and Other and White Students 
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reveal that both program groups have significant advantages over their 
. non--program counterparts* 

The post-^test results for both cognitive and affective tests show 
that both program groups have benefitted equally from the prograin to the 
extent that they can score somewhat higher than thisir non-program counter 
parts in the May testing* Although the eighth grade Black and ot: :r pro- 
gram students began the year at a slight disadvantage * they ware able to 
gain eorisiderably during the year and complete the year with a cognitive 
test score that was somewhat higher than their non-program counterparts'. 
The post-test results for the third grade white program students were 
considerably higher t an their non-program matches and suggest that they 
may have benefitted slightly more from program efforts than the Black and 
other program students at this grade level. 

In generals the program appears to be affecting both program groups 
more so in the cognitive domain than in the affective domain* The method 
of instruction and experienGes provided through the progrum have ^iven 
both Black and other students and white students an equal opportunity to 
gain mora than their non-program counterparts. The post-test results for 
both program groups suggest that the white program students have achieved 
slightly more cognitive and affective learning- than the Black and other 
program students. These results imply that the program may consider 
modifying its curriculum and teaching methods to allow Black and other 
program students , to achieve to the same extent as the whdte program 
students*' = ^- 

The results of the tenth grade analysis for both demographic groups 
support our earlier conclusions. Neither Black and other students nor 
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vhlta students were able to display superior knowledge or attitudes over 
their non^program counterparts. It appears that neither group has benefitted 
from program efforts, 

Reaulta_ fox, Academic and Non-Acadsmic Students , A comparison was made 
to determine if at the tenth grade levels the program had InfluenGed 
^:^Che learning of students enrolled an academic curriculum more so 
than students enrolled in a non-academic curriculum^ or if the reverse 

were truei The results of this analysis appear in Table 8* 

^ ., * - - 

The pre-test results indicate that the program students at the begin-- 
ning of the year had a definite advantage over their non--program counter-* 
.parts. The scores received by the academic program students on both the 
cognitive' test and the affBctlve test were significantly higher than their 
non--program matches. The pre-test results for the non-'academic students 
shov^ that these students also had an sdvantage over their non=program 
counterparts; however j the difference between program and non-program 
scores is not statistically significant. These results suggest that both 
program groups had an advantage over their non-prDgram matches at the time 
of the pre-^test and should have been able to maintain this lead through- 
out the year* By comparing the two program student populations ^ it is 
apparent that academic program students also have an advantage over the non- 
academic program students. This is not surprising in that academic curri- 
culum is usually geared for studefits preparing for professional careGrs 
and often contain the better students at a given grade level p 

The post-test results show that neither the academic program students 
nor the non-academic program students were able to obtain scores that 
were higher than their non--program matches. Future program efforts should 
definitely be directed coward reaching all students in the tenth grade 
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with more inf oniiation and roore aKperiences that would ln£jnence their cog- 
nitive and affective learning. 
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CONCLUSIONS AND RECOMMENDATIONS 

m\f . • " 

Based on, the results from the pre-teat and post-test administered 
tf--' t© the' Cinelnnati Career Developnient Program students ^ PSE offers thase 
^f^'"' final conclusions and recotnmendations * 

iirk • • ' 

if.^-f,=-i<. I.: ■ : 

The program staff has been instrumental in changing teacher behavior 
•^'v and modifying curriculum content to the -totent that 

I-' 

ft? ' rrograiB students in grade 3 were able to end the year showing 

? superior knowledge and attitudes towards careers-related concepts 

on bo.th the cognitive and affective tests when compared to non^ 
^ program students. 

% ' ' 

• Program students in grade 8 were able to end the year showing 
|r-- superior knowledge of career information when compared to non^ 

program students on the cognitive test, 

fi:.- 

• Program students in grade 6 were able to end the year displaying 
somewhat more knowledge of career-=related concepts than their 

r> ■ 

H-f non-^program counterparts on the cognitive test. 



• Prdgram students in grades 6 and 8 were able to display slightly 



better attitudes than their non-program counterparts on the 



affective section of the May post-test. 
# Although program students in grade 10 were able to show superior 

Wi ■ ^' - 

Knowledge over their non--program matches at the time of the October 
' pre^testj they were not able to obtain higher scores on either 
the cognitive or the affective test in the May post^test, 
?p- PSE concludes that the program in Cincinnati has been able to influence 

the cognitive learning of its students more so than the affective learning* 
Foseible attention should be directed towards experiences and activities 
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g::;v ^hich TOuld Influence the affective learning of students; howevar> the 
program students In Cincinnati do hold ralatively positlvG attitudes to- 
wards career edueation^ as indicated by their test scores , and it may be 
difficult for the program to raise these scorGs considerably. The program 



W^j: ■ ■ .... 

srS/. appears to have made the greatest impact on its third grade students in 

i-- 

^y. . both cognitive and affective learning and its ©ighth grade students' 

cognitive learning. To a lesser eKtentj It has also influanced the cog- 



A- : 



pCi; nitive and affective learning of its sixth grade Gtudents. ■ The tenth 
• , grade is definitely the weakest area of the program and decerves considerable 

attention in the coming year. In generals where the program has made an 
■i- impact it has provided program students, with a definite advantages over 

their noij-program counterparts* 
^ Further conclusions Indicate that the program has also been successful 

in influencing the instruction of its students to the eKtent that 

• The program students ^wjate able to Bhovi more knowledge and better* 
: attitudes,.4^-^^-«aph ofi/jvthe developmental areas in grades 3, 6j and 

8 at the time of the May post-test. 

• Both program boys and progrnm girls are receiving equal benefits 
" from program efforts, 

• Both Black and other students and white students are benefitting 
i/ from program ef forts s-=although white program students appear to 

have a slight advantage over Black and other program students in 
the amount of cognitive learning they have a&hieved by the May pQSt= 
teat, 

. m At the time of the pqst^testj the program had not affected either 

academic or non^acadcmic students to any extent* 
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In most cases, the program has provided instruction and experiences 
that have influenced the learning of all these students in grades 3, 6| 

0'^'::^;. an3 8* It has provided a v^ell^-rounded approach to careor-'development 

fe" that has been received well by its studGuts* Future progi^ani efforts 
ehould consider modifying curriculum and teaching methods to provide 
^ Black and other students with the same opportunity to achieve as their 

f white counterparts. Our strongest recomniendation rauld be to strengthen 
. the tenth grade Exploration component. Our earlier visits to Cincinnati 
indicated that the program was Initiating changes which would influence 

V the tenth grade program considerably* We would hope that during the 
1976^77 school yearj program efforts in the high school would be more 

T: visible and considerably more successful* In totals the program is sup- 
plying its students In grades 3, 6j ^nd 8 with n good understanding of 
career development concepts and experiencQS v;]iich influence positive attitudes 
towards these concepts. Therefores we would emphasize that the tenth 

r ■ v~^r-ade program be strengthened so that the good foundation of career develop- 
ment built in the earlier grndes be carried through to the tenth grade 
where the program students are often making career decisions * 
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Findings for Cleveland 

As mentioned above ^ the results for each test: adminlBtration were 
rsported by Item, by developmental ai^ea yrcuplngs, and by total cognitive 
or affective test scores for each city, each grade, and each student group. 
The findings for Cleveland are displayed in thi data analysis tables ep- 
paaring in the text or in the Appendix, (The pr&-test and post-test data 
appear in AppendlK 3 , ) 

The follovTlng sections will describe the pre-test/post-test changes 
that occurred in each grades as well as changes that occurred in various 
student groups. 

Student Characteristics , As noted in Table 2 of the Procedures section , 

the pre--test was administered to 1,467 progrOT. students and 486 non=program 

Students, while the post-^tasc was administered to 1,398 program students 
and 501 non--program students. The number of program students participating 

iji both the pre^test and po^t-test was sufficient to represent the program 

at the various grade levels. Likewise , the number of non-program students 

compared to program students for both test administrations was large enoush 

at each grade level for var^ 'is CDmparlsons to be made, 

- For each test administratio/ , tbe distribution of program students 

and non-^program students at each grade level appears in Table . The pro-- 

gram and non=program student populations for both test administrations 

rft - 

L.were made up of approximately an equal number of boys and girls at each 
grade level. Also, both program and non--program populations contained 
predominantly Black and other studento. The tenth grade program, population 
for both teat administrations contalncid approKlmately 30% students enrolled 
In an academic curriculum and 70% students enrolled in a non--acadcmiG cur- 
riculum- while the non-prooram tenth grade population contained approxinctc^ly 
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Percent of Items Anst?ered Correctly^ 
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15% students enrolled In an acsdemlc curriculum and 85% students enrolled 
In a non'^academic curriculum* 

For the various analyses which werfc runs sample si^e was considered 
vhen- computing the "t" value. Based on the data appearing in Table 4 and 
the Information supplied by the program director concerning conipar ability » 
the overall program and non--program groups seamed to be as comparable as 
vi wDuld hope to find,- 

Overall Res ults * The overall results for the cognitive test (showirTh 
Table 5) Indicate that at most grade levels the program students started the 
year with a bettor^ understanding of career-related concepts than the non-'program 
etudents. The greatest difference appeared in grade 3^ where the difference be= 
tween the program and non-program scores on the pre-test was considered to be 
atfttistically significant. The post»test results for grades 3 and 6 indicate 



that the program students finished the year slightly ahead of their non- 
progr^ matches also, Thn difference between the program and non^program 
overall scores on the post-test^ however, is not as great as the difference 
that listed at the pre-test. This indicates that although the program 
students ware able to display more knowledge of caracr-ralatad concepts 
in the >Iay testing^ their non-program matches had actually gained more 
career information during the year. The non^program students in grade 3 
ended the year alightly ahead of where the program students had begun the 
year* This indicates that the informaclon the program students had re- 
eeived prior to beginning third grade had placed them approximately a year 
ahead of their non-program counterparts, but that during the third grade 
year the non-program students were able to catch up and end the year with 
•approximately the same amount of knowledge as the program students. The 
results for the sixth grade cognitive test Indicate that although the pro^ 
gram students started with slightly more career knowledge than the non- 
program students, the non-program students were able to end the year at 
approKimately the same place as the program students. 

The eighth grade program students started out slightly behind the non- 
program students but ended the year displaying morr i^nowledge of career- 
related concepts than the non^prograin students. Il is interesting to note 
that the non-program students* pre-test score w. : higher than their post- 
test score. The results of the tenth grade post-test indicate that the 
program students, although starting out the year - thaC far ahead of the 
non-program students , concluded the year with an iv. erage score that was 
significantly higher than the non-program students. As was the case with 
the eighth grades the non-program score on the post-test was considerably lower 
than its score on the pre-test. 
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In general, the program students in grades 3 and 6 started the year ... 
knowtag somewhat more than the non^program students and were able to show 
a slight difference over the non^program students at the end of the year. 
Although these differences are not as drastic as we would hope to find, 
±t does indicate that the program has made an impact on its students in 
these grades. In gradas 8 and 10 ^ the program students did not have as 
great an advantage over their non=program counterparts as the elmentary 
grades J but they were able to show a much greater difference in the amount of career 
knowledge held by program students when compared to non-program students 
in the >toy testing. 

The affective results indicate that the program students hold somewhat 
more positive attituclcis towards the concepts presented through career educa- 
tion than the non-program students* The test results for the pre-test and 
post— test do not indicate that the program students have been Influenced 
by the prQgr:_^m in the 1975-76 school year to the extent that their attitudes 
have changed between the pre-tcsting and the post-testing sessions* In fact, 
the program scores decreased in three of the four grades* However , when 
comparing the program post-test scores with the non-program post-test scores 
at all four grade levels ^ the program was able to score somewhat higher than 
the non-program on all four tests. 

It appears that the effect of the program is more easily distinguished 
on the cognitive test than the affective test* This is not surprising in 
that it is often easier to supply students with more Information than to 
change their attitudes. Apparently the program has been successful in 
supplying the students with career-related information and concepts and 
somewhat less succassful in influencing the attitudes held by its students. 
The most tapresslve results occur in the tenth grade where the post^test 
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results for both the cognitive and affective tests of the program students 
were statietically significant and definitely show that tha program has 
made an effect on the amount of career infonnatlon and the degree of posi-- 
tive attitudes held by these students. At this grade level when students 
are often involved in Tnaking career decisions ^ it is very important to 
present a strong program that offers students inforttation and guidance, 

iResu Its for D e ve l_o pm fin t a 1 Ax_e a s * As mentioned earlier , the results 
©f the cognitive and affective tests were also analyEed by developmental 
areas* The number of items In each developmental area was presented in 
Table 1 of the Procedures section* The number of items In each develop- 
mental area differed at each grade level* l^en looking at the results 
from both the pre-test and the post^tcst at each grade level, the develop- 
mental areas can be ranged by "t-- values to show areas In which the program 
students showed superior knowledge or attitudes C"'t*" values above 1,65); 
. to show areas where the program and non^program students were equally 
informed ("t" values from -1.65 to +1*65); and finally, to show areas in 
which the non-program students sho*..?ed superior knowledge or attitudes (""t" 
values above =1*65), 

The results from the third grade pre^^test Indicate that the program 
students began the year with superior knowledge in the areas of Employ- 
ability and Work Adjustment Skills g World of Work, and Economics- In each 
©f these areas on either the cognitive or the affective tests, the results 
show the superiority of the program students over the non^program students | 
however, this superiority did not continue throughout the year* At the time 
of the >iay post-test, the program studentG were only able to score somewhat; 
higher than the non^program studGnts in the areas of Employabillty and Work 
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Adjustmenf Skills and World of Work. These scores were not significantly 
hlgherp but did indicate some program strength. 

In general 5 the tnird grade results indicate that the program students 
were able to begin the year In a much stronger position for each of the 
developmental areas than the non^program students. However , they were 
not able to rsaintain this difference throughout the year. Apparently ^ 
the non=program students were also being Instructed in several of the 
developDiental oreas and gained in cognitive as well as affective learnlng- 
The pre^test results indicate that the program may have possibly been 
roore successful in-the grades preceding third grade and less successful 
during the third grade year. 

The results for the developmental areas at the sixth grade Indicate 
that at the time of the pre^test the program students held significantly 
BBore knowledge in the area of Self and significantly better attitudes in* 
the area of World of Workp The program students were able to maintain better 
attitudes in the area of World of Work throughout the year and the post-* 
test results indicate that the program students held significantly better attitudes 
in this area as well as the area of Education and Training, The cognitive 
results s hov7evers do not indicate that the program students have superior 
knowledge over the non^prograra students in any of the seven developmental 
areas. In factj in some areas the program students" scores were slightly 
less than the non-program students'. 

In totals it appears that although the program students started 
the year with slightly more knowledge in each of the seven developmental 
areas than the non^prograin students s as the yaar progressed the amount 
of additional inf oriTiation the program student. s received in ieach of the 
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developmental areas was not sufficient enough for them to show superior 
knowledge over the non-rprogram students by the and of the year. 

The results for the developmental areas at the eighth grade indicate 
that the program students began the year with slightly lower scores 
in five of the seven developmental areas than the non^program students 
on the cognitive test* By the end of the year, the program students 
were able to show considerably more knowledge of career^related concepts 
than the non=-prograta students. In the areas of Education and Training 
and Self i the program students were able to show superior knowledge 
over the non^program atudsnts. The affective results show that although 
the program students' scores did not change considerably over the ^^ear^ 
the difference between program and non^program students' scores increased. 
The post-test results show that the program students held considerably 
better attitudes than the non-^program students in the areas of Individual 
.and Environment and World of Work. In all other areas j the program students 
scores were somewhat higher than the non-program students'; this differonce 
suggests that the program students gained much more favorable attitudes 
towards the concepts than the non-program students. 

In generals the program has made a much clearer impact on its 
eighth grade students than the previous eleraeutary students. The 
differences between program and non-program scores for the overall 
cognitive test and overall affective test are much greater at this level 
than the previous grade levels. It appears that the program is providing 
its students with information and experiences that influence cognitive 
and affective learning in all seven of the developmantal areas. 

The results for the developrnental areas at the tenth g^rade indicate 
that the program has made considerable impact on its students at this 
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grade level In five of the seven developmental areas represented on the 
eegnitlve test and all seven of the developmental areas represented on the 
affaatlve test. The pre-^test results indicated that both program and 
non-^program students had a good understanding of the eareer-related con- 
cepts in each of the seven developmental areas on the Gognitive test* 
However* in the course of the year the program was able to provide its 
Students with considerably more Information in five of the seven develop- 
mental areas and consequently^ the program students scored eignif icantly 
higher than the non-program students in these five developmental areas* 
The overall results for the cognitive post=test denote that the program 
has made considerable impact on its students at this grade level and has 
given them a clear advantage over their non^program counterparts. The 
pre-test results for the affective test indicate that both program and 
noii-program students held largely positive attitudes towards the con-- 
eepto presented ^hiL igh career education. As was the case with the cog- 
nitive results, i^^f' affective post-test results reveal that the program 
students ended the year with significantly more positive attitudes 
towards career-related concepts than the non-program students. 

The pre-»test/post-test results for the tenth grade definitely display 
a program that is making an impact on its students* cognitive and affect- 
ive learning. The tenth grade program encompasses all seven deVGlopmental 
areas and gives its students an impressive advantage over their non-program 
counterparts. 

In totals the Cleveland Career Development Program is providing 
its students with a well-rounded approach to career education. At each 
grade level, there are obvious strengths and weaknesses. Surprisingly, 
the program appears to be stronger at the junior high and senior high 

123 



levels. This is quite impressive in that PSE has found that it is much 
mora difficult for local school districts to implement a strong career 
education program at these grade levels. The Cleveland program has 
obviously made a successful attempt at reaching teachers and students 
at these grade levels and their efforts should be continued. Possible 
future pi'ogram efforts might be directed at reaching the elementary 
levels and providing these students with the same advantage over non= 
program students as the Junior high and senior high students. 

Results for Boys and Girls , The results of both the cognitive and 
affective tests were also analyzed to locate differences between program 
boys and non^program boys and also program girls and non^program_gir^ls*-^ 
The overall results for the cognitive and affective tests at each grade 
level for both test administrations appear in Table 6, 

The pre-test results indicate that at the be^inring of the school 
year both program boys and program girls knew relatively the same amount 
of career information and held relatively positive attitudes towards 
career education* The pre-*test results also show that both program groups 
knew relatively more about career education and held relatively more 
positive attitudes towards these concepts than their non-^program matches s 
with the exception of the cognitive results for the eighth grade girls* 
These results suggest that both program groups began the year with a 
slight advantage over their non-program matches but at an equal level 
with their program counterparts* 

The results for the cognitive section of the post--test show that 
both program boys and program girls ended the year knowing slightly more 
than their non-prograin matches, with the oxception of the sixth grade 
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PercQnt of Iteins Ansv^ai'ed CDrrcctly by Boys and Girls 
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progrsm boys. These ovarall results suggest that the methods of instruct- 
tlon and aetivlties presented through the program have given both program 
hoys and program girls an equal opportunity to benefit. 

The affective results for the post-test show that both program boys 
and program girls completed the school year with attitudes that are slightly 
faore positive than their non^program counterparts * As is the case with 
the eognitive results, both program groups appear to be receiving equal 
benefit from the activities and eKpariences provided through the program 
that influence affective learning. 

Results for Black and Other Students and VThite Students . PSE had 
planned to make coraparisons to determine if the program had had more 
' ' affect on either of these two demographic groups. Because both program 
and non--progrMi populations contained predominantly Black and other 
GtudentSs these comparisons would result in observations that are iden= 
tical to the overall results for program and non-^program students at each 
grade level* Table 7 shows the distribution of the scores for Black and 
other students and white students. Inmost cases, the number of white 
students represented in the samplt was not large enough to generate 
tables and no scores were reported. 

Results for Academic and Non-AcadeTnic Students , At the tenth grade 
level p an analysis was run to compare the results between students enrolled 
in an academic curriculum and students enrolled in a non^-academic curri- 
culum for program and non-program students- The results of this analysis 
are shovm in Table 8. The pre-test results indicate that both the program 
and non-^program academic students had an advantage over the non^^academic 
students from each group in the beginning of year on both the cognitive 
and affective tests. The academic students were able to maintain this 
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Table 7 

Percent of Items Answered Correctly by Black and Other and I-Jhlte Sttidentg 
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Table 8 

, ■ " Percent of Items Answered CorrGctly by 

■i? - jCurricuium Groupings 
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advantags over the non-^aeademiG students throughout the year and the post- 
test results ehow that both groups' of academic students scored higher than 
the non-academic students at the find of the year* It is not surprising 
that the academic students of both groups scored higher than the non^academic 
students of both groups. Academic curricula are usually geared for 
atudents who are preparing for college or professional careers, and there-- 
fore contain the better students at a given grade leval. 

When comparing the two program groups to their non-program counters- 
parts," both program groups began the year with a slight advantage over 
their non-program matches and completed the year with an even greater 
margin of difference between program and non-program students' scores. 
Although the academic program students have a slight advantage over the 
non-academic progr::n fttuGentSj both groups appear to be benefitting equally 
from program Tcrtft and ars able to display cons'iderably more cognitive 
and affecti/^ learn;ing than their non-program matches* 



CONCLUSIONS MD RlCO>D'ffiNDATIONS 

Baaad on the results of the pre-test and post^test, PSE offers these 
final eonclusions and recQ^endations • 

The program staff has been instrumental in changing teacher bahavior 
and modifying curriculum content to the extent thati 

• Program studants in grades 8 and 10 ware able to end the year 
showing superior knowledge of career-related concapts whan com-- 
pared with non-^program students. 

• Program students in grades 3 and 6^ although starting the year 
slightly ahead of their non-program matches ^ ended the year 
displaying knowledge equal to that of the non^program students* 

• Program studants in grades 3, 6^ and 8 ended the year with slightly 
better attitudes than their non-^program matches* 

• Program students in grade 10 completed the year with significantly 
different attitudes than their non^program counterparts. 

Therefore J PSE would recommend that program efforts at the junior 
high and senior high be continued. Increased participation on the part 
of teachers and students possibly will raise the overall scores on the 
cognitive and affective tests for these students and assure that all 
students are receiving the career information and experiences that are 
necessary for making good career decisions. Future program efforts may 
be directed towards the elementary grades andp thus, giying these students 
the same advantages as the junior high and senior high students over their 
non-program matches. 

Further conclusions indicate that the program has also been succesn- 
ful to the extent thati 



• It la providing its students with a well=rounded approach to career 
education as avidencad by the test results for developmental areas. 

m The methods of instruction and activities presented through the 
program have given both program boys and program girls an equal 
opportunity to benefit* 

• ^though the academic program students have a slight advantage over 
the non-academic program students, both groups appear to be bene-^ 
fitting equally from program efforts and are able to display consi-- 
derably more cognitive and affective learning than their non'-program 
matches • 

PSE feels that these are fair observations of the Cleveland v^nieer 
Developraent Program and relate well to what we observed while wi, vu 
visiting the local school district. The program has been very sucncasful 
in imp lamenting a career development program that can show differences in 
learning between program and non-program students* The strength of the 
program lies in the Orientation and Exploration components* As we stated 
earlier, this is very impressive, PSE often has to search far and wide 
to find Junior high and senior high programs that are so well developed * 
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(glndinga for Springfield 

■V:?:^ As. men t lone abovas the results ior eaeh test admirilstratlon were 
reported by it em, by developmental area groupings, and by total cognitive 
and affective scores for each city, each grade, and each student group. 

The findings for Springfield are displayed in the data analysis tables 
appearing in the text or in the Appendix* (The pre-test and post test 
data appear In Appendix 4 

Thei following sections will describe the pre-^test/post'-test changes 
that oecurred in each grade, as well as chf^nges that occurred in various 
student groups, 

Student Character istics. As noted in Table 2 of the Procedures sectionj 
the pre-test was administered to 1,443 program students and 435 non^program 
students, while the post-cest was adminio tared to lj312 program students 
and 429 non^prograTn students. The number of program students participating 
in both the pre-test and the pQSt--test was sufficient to represent the 
program at the variouf grade levels. Likewisej the number of non'-program 
students compared to program students for both test administrations was 
large enough at each grade j.uvel for various comparisons to be made* 

For each test administrations the distribution of program students 
and non=program students at each grade level appears in Table 4* For both 
the pre-test and the post-test ^ the program and non-program populations 
contained approKlma tely an even division between boys and girls at each 
grade level V Also, for both test administrations i the third and sixth 
grade program and non*-program student populations contained predominantly 
white students. The eighth and tenth grade program population was more 
evenly divided between Black and other students and white students, while 
the non-program population for these grades contained predorainantly white 
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'students. Both program and non-program tenth grade populations were largely 
tmdm up of students enrolled in a non-academic curriculum, with studente 
'Enrolled in an academic curriculum representing approsimately 20% of the 
program population and 37% of the non-program population. 

For the various analyses which were run on the dataj sample size 
was^ considered when computing the "t" value. The informatiQn supplied by , 
the program director concerning comparability suggests that possibly the 
selection of non-program schools was not the best choice. Although the 
non-program schools came from the same school district as the program schools 
it was felt that the non-program studentSs espeqially in grades 8 and 10^ 
were recei%^ing some sort of career education. Therefore ^ it was considerably 
harder for the program students in Springfield to show superior knowledge 
over their non-program counterparts. 

Overall Results ^ The overall results for the cognitive and affective 
teats for both the pre^test and post^-test appear in Table 5, The overall 
results for both the cognitive and affective tests Indicate that in 
grades 3* 8j and 10, the program students started the year at a slight 
disadvantage when compared to the non^program students. In these three 
grades* the scores received by the program students on both cognitive and 
affective tests were slightly lower than those received by the non-program 
students. In grade 6^ however, the program students began the year with 
a alight advantage over their non=program matches on both the cognitive 
and the affective tests* The difference between the program and non--program 
scores on the sixth grade cognitive test was significant* This 
indicates t^at the program students had a definite advantage over their 
non-program matches. 

The pre--test results for the third grade program students are cxccp- 
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;^=diff erencea that existed at the time of the pre-test. This seems to indi- 
cate that although the program students were not able to score higher than 
the non-^program students, they were definitely benefitting from program 
afforts and were able to show considerably more cognitive learning and slgnlfl- 
aantly better attitudes than the earlier protest results* 

In BQOSt caseSj the program has made an impact on its students which 
enabled them to increase their scores on both the cognitive and affective 
tests during the course of the year. The gain in students' scores is 
impressive j especially in grades 3 and 10* PSE would certainly recommend 
that in future testing efforts, a better choice of non-program schools be 
made* The results from the pre-test/post^test seem to indicate that if 
matched against schools where students were definitely not receiving 
career education^ the students of the Springfield Career Development Program 
would undoubtedly appear to be better informed than the non-program students. 

Results for Developmental Areas . As mentioned earlier, tAe results 
of the cognitive and affective tests were also analyzed by developmental 
areas. The number of items in each developmental area was presented in 
Table 1 of the Procedures section* - The number of items in each developmental 
area differed at each grade level, \ThQn looking at the results from both 

-the pre-test and the post--test at each grade level, the developmental 
areas can be ranked by ''t" values to show areas in which the program 
students showed superior knowledge or attitudes ("t" values above 1*65) i 
to ehow areas where the program and non^-program students were equally 
informed ("t" values from =1,65 to +1,65); and finally^ to show areas 
±n which the non^program students showed superior knowledge or attitudes 
("t" values above -1,65)/ 
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Jj^itlenally low and Imply that there la a definite need to etrengthan the K-2 
S^?Jii^^rajn. In the ather three grade levels (6, 8, and 10), the program 
f^istudeiiti' pre'-test leeres a^e average, and this suggeata that the program 
has supplied gtudsnta with some career: Infomation and eKperienoea that 
influsncs attitudes in aome earlier grades. 

The post-test resulti for both the cognitive and affective teats 
ravaal that the prograBa students gained considerably during the years with 
tha exception of the sdbcth grade cognitive results. In grades 3 and 6, the 
program students were able to achieve scores on the May post-^test that were 
equal to or slightly higher than their non-program counterparts for both 
the cognitive and affective tests. The third grade results imply that the 
program was able to make a considerable impact on its students at this 
grade level and to give them a definite advantage over their non-^program 
counterparts by the end of the third grade year. The sixth grade results 
do not show as great a program impact* The sixth grade program students 
began the year with an advantage over their non-'program matches and ended 
the year displaying more knowledge of career development concepts than 
^the non-program students. However^ the difference between program and 

non--program students' scores on the cognitive post-test was not as great 
^ as the difference that was evidenced In the pre-test. 

The results for the eighth and tenth grade show that although the 
program students were not able to score as high as the non-program students 
on either of the two tests, they had gained considerably during the course 
of the year. This is especially true for the tenth grade students, whose 
post-^test score on both tests was thirteen points higher than their pre- 
test score* For both tenth grade tests, the difference between program 
and non-program scores on Che post^test is considGrably smaller than the 
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The results from the third grade cognitive and affective pre-teat 
'indicate that the progrmn students knew considerably more about concepts 
relating to Imployability and Work Adjustment Skills than the non-program 
students at the time of the October testing. In all other areas, the 
program students were slightly behind the non-program students on either 
the cognitive or the affective test* By the time of the May post-test^ 
the program students had acquired considerably more knowledge concerning 
career education concepts and considerably better attitudes towards these 
concepts than they had displayed during the earlier testing. The results 
for the cognitive post-test show that the program students were able to* 
score higher than the non-'program students in six of the seven develop- 
roental areas, and that in two of the areas (World of Work and Employability 
and Kdrk Adjustment Skills), the difference between program and non-program 
TCores^ wa^^^roTrsidered to be statistically significant- The post-test 
^^results for the affective test show that both groups were able to display 
considerably better attitudes towards career-related concepts than their 
earlier test results* For most developmental areas, however, the difference 
between program and non-program students' scores la not great and does not 
Indicate any real program strengths. 

In summary, the program is providing Its third grade students with 
career information and experiences relating to all seven developmental 
areas, thus resulting in increased learning. Future program efforts should 
cSffitinue to provide its students at this grade level with a well-rounded 
approach to career development. 

The overall results for the slx^ rade prc-test indicate that the 
program students began the year with a uef lnite advantage over the .non- 
program students on the cognitive test and a slight advantage over the 
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= lion-program students on the affective test. The strongest developmental 
arama at the time of the pre-test were World of Work and Education and 
Tiraining« In both of these areas, the difference between the program students 
and non-prograra students' scores was statistically significant* During the 
couree of the year, hovrever, the non^program students were ^ble to catch 
up with the program students In most developmental areas. The post--test 
results do not indicate that any of the developmental areas are strong 
parts of the sixth grade program* The siKth grade program students ended the 
year knowing slightly more about career education and holding slightly 
more positive attitudes than the non-program students. 

In general I the sixth grade program appears to be providing students 
with information and experiences In all seven of the developmental areas ^ 
but it could provide its students with more Information and activities , ThuSj 
It would ensure that its students would end the year with the same advantage 
over the non=program students which they held at the beginning of the year* 

The pre«test results for the eighth grada indicate that the program 
students began the year at a slight disadvantage In all seven of the develop- 
mental areas on either the cognitive or the affective tests* In all seven 
of the developmental areas, the non--prQgram students were able to score 
somewhat higher than the program students* These results show that in 
October the non-program students knew considerably more about career^-related 
concepts pertaining to%all seven of the developmental areas than the 
program students. This situation would make it very difficult for the 
progrmi students to gain throughout the year and to end the year scoring 
higher than the non-'program students* 

Thm post-test results show that although the program students were 
able to raise their scores in most of the developmental areas 
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the cognitive and affective tests » they were not able to deerease the 
dlfferenea between the program and non-^program students- scores in any 
of the developmental areas. Thuij the non--program students concluded the 
year knowing considerably more than the program students in each of the 
seven developmental areas and holding relatively more positive attitudes 
towards those concepts represented in the developmental areas. 

These results suggest that although the program students were able 
to gain higher, scores on the post-^test than the pre-'test^ the program 
could have made a greater impact on the cognitive and affective learning 
of its students at this grade level. The program students definitely 
started the year at a disadvantage, but through program efforts should 

have been able to decrease the margin of difference between their scores 

.... ^ 

and non--program students' scores. Future program efforts should be directed 
towards reaching students in the Orientation component with more Information 
relating to careers and more eKperiences that would influence attitudes in 
all seven of the developmental areas* The weakest developmental areas 
Indicated by the post^-test results appeer to be World of Work^ Economics , 
and Decision-Making, 

Thm results for the developmental areas on the tenth grade test indi- 
cate that the program students in Springfield began the school year knowing 
considerably less than the non-program students with whom they were compared 
In all seven of the developmental areas on either the cognitive or the 
affective tests. This disadvantage made it very difficult for program 
Students to end the year displaying more knowledge or better attitudes 
than their non-prograiju.patches . 

' The post-^test results reveal that the program had made a definite 
Impact on its students. In each of the seven developmental areas ^ the 
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^program studenti were able to ralee their ecorea cDnelderably from their 
vearlier pre-test scores, and the margin of differenee between program and 
non*-prbgram students- seores in each of the developmental areas was greatly 
decreased. By the ttae of the May post-teat* the program studenta were 
able to receive scores that were equal to the non--program students In the 
areas of Employability and Work Adjuatment Skills and Economics. In all 
-other areas J the difference between program and non-program students* 
scores was not that great. The major difference occurred on the affect, 
test in the area of Individual and Environment, and the next largest dif- 
ference occurred in the area of Decision-Making on the cognitive test. These 
results show that the instruction and experiences offered by the Career 
Development Program were able to influence the cognitive and affective 
learning of its students considerably during the 1975-76 school year. 
Program efforts should definitely continue to provide its students with 
'Information and eKperiences relating to all aeven developmental areas at 
this grade level* 

Hesulta for Boys and Girls . The results for both the cognitive and 
affective tests were also analyzed to locate differences between the pro-- 
gram boys and nQn-program boys and also program girls and non-^program girls. 
The overall results for the cognitive and affective teats at each grade 
level for both test administrations appear in Table 6. 

The pre--test data indicate that both program boys and program glrla 
began the year with equal knowledge of career education concepts and equally 
positive attitudes towards these concepts. This implies that the methods 
©f instruction and activities provided by the program could be equally 
received by program boys and program girls ^ and that neither group had 
an advantage over the other group at the beginning of the school year. 
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The past-teat results show that the program made an equal Impact on 
the cognitive learning of both program boys and program girls in grades 
3i 6, and 10. At these three grade levels * the cverall scores for program 
boys and program girls are very similar* In grade 8, the program girls 
received a much higher score than the program boys and this indicates that 
possibly they have benefitted more from instruction that Influences cog-* 
nitiva learning than the program boys. The post^test affective results 
indicate that the program has Influenced both program boys and program 
g.'^'la to the sama axtent at all four grade levels # In general , the program 
Is providing both program boys and program girls with an equal opportunity 
to benefit from its efforts. 

Whan comparing the cognitive results for both program and non^program 
4*oys and girls, it Is evident that both program groups received instruction 
that would enable them in grades 3 and 6 to show cognitive learning of 
career development concepts that was equal to or slightly better than 
thair non^program matches. In grades 8 and 10 , where the competition was 
slightly greater, neither program group was able to score higher than their 
non-program matches on the cognitive post^test. 

The affective results for the post^test reveal that the program and 
non-program boys and girls hold relatively close to the same attitudes. 
In grade 6^ both program groups were able to score slightly higher than 
their non-program counterparts | while program boys and program girls in 
gradas 3 and 10 scored slightly lower than their non--program counterparts. 
In grade 8, the difference between program and non-program scores was 
much larger than at any other grade level* Both non^program boys and 
non-program girls received considerably higher scores than their program 
counterparts. Thus, both program groups were able to show more cognitive 
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J^grewth than affective growth and in most casee, both program groupi wera 
^pri^^:]^.mblm to compare well with their non*-program matches in the llay post--test. 
In suiMary^ where the program has made an impact on its stud ant a, it hae 
'^'^Si.^ixitlM&mmd the learning of both program boys and program girls to the sama 
degraa^r 

Si,. Results for Black and Other Students and White Students . , The pre-test 

and post-*test data were also analysed to determine if the program has had 
more effect on either of these two demographic groups* The results of 
this analysis appear in Table 7 , 

The pre-test results indicate that at the beginning of the year both 
program groups had acquired approKimataly the same amount of cognitive 
learning, with the graatast difference occuring in grades 6 and 8^ where 
the white prDgram students scored somawhat higher than the Black ar,i-other 
program students on the cognitive test. Also, both program groups began 
\\ the year at a slight disadvantage whan compared to their non-^program counter 

yr v. ■ 

I'; parts, except for the grade 6 white program students who began the year 
P knowing significantly more than the white non-^program students. Although 

in most cases, both program groups bi^rgan the year at a disadvantage * several 
of the groups were able to gain during the year, and the result of the post- 
test placed tham slightly ahead of their non-program matches . This is true 
for both program groups in grade 3, the whita program students in grade 6, 
and the Black and other program students in grade 10* In each of these 
cases ^ the program groups achieved scores on the May test that were higher 
than their non-program counterparts , When comparing the results of the 
Black and other program students and the white program students on the 
Jfey post-test, it appears that the white program students were able to gain 
cdnslderably more cognitive learning than the Black and other program 
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students* At all four grade levels i the white program students received 
a higher icore than the BlaerS and other program students. 

In general J it appears that the progratn is influencing the learning 
of both program groups, but that the white program students are able to 
shaw more learning than the Black and other program students* Future 
program efforts could possibly consider raodifylng curriculum and teaching 
methods to provide Black and other students with an equal opportunity to 
acquire knowledge of career education concepts. 

The results for the affective section of the ppst'^test are similar 
to the cognitive results* In most cases, both program groups began the 
year with slightly less positive attitudes than their non-program counter^ 
parts* By the end of the year, the program had influenced the affective 
learning of both groups to the extent that the program students were able 
to score slightly higher than the non^program students in several instances 
The Black and other program students in grades 3, 6j and 10 received scores 
on the pQSt-'test that were equal to or slightly higher than the Black and 
other non^program students' scores. At grade 6^ the white program students 
were also able to obtain a score that was slightly higher than their non- 
program match. These results indicate that to the oKtant the program has 
influenced the attitudes of its students s it has affected the attitudes 
of both student groups* Both program groups received scores on the affect- 
ive post^test that were very similar and indicate that neither group has 
an advantage over the other in affective learning. 

In totalj the program is providing Its students with an advantage 
over their non^program counterparts in most grades* 
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Results for Aeademlc and Non "Academic Students , At the tenth grade 
level, a eomparlson was made to determine how the program had influenced 
the learning of students in an academic curriculum and students anrolled 
in a non^academlc curriculum when comparad with non^program Mtches*_ The 
results of this analysis appear in Table 8, 

As was Indicated earlier, the .enth grade program students began the 
year with a slight disadvantage when compared to their non-program counter- 
parts. This is true for both acadeirlc program students and non-academic 
program students. The scores on the pre-test for both of these groups 
were somewhat lower than their non-program counterparts' on both the cogni- 
tive and affective tests. Also, the non-academic program students had a 
disadvantage when compared with the academic program students at the tima 
of the October testing. The academic program students were able to score 
considerably higher than the non -academic program students. This Is not 
unusual in that academic curricula are usually geared for students pur--^ 
suing professional careers and often contain the better students at a given 
grade level. 

The cognitive results for the poGt-test showed that although the aca- 
d^ic program students were able to raise their overall score, they were 
not able to show superior knowledge over the academic non--prograra students. 
This. indicates that although they had received instruction that Increased 
their learning of cognitive concepts, the program academic students did 
not learn more than the non-program academic students. On the other hand, 
the non-academic program students raised their score on the cognitive test 
considerably and were able to show equal learning of career development 
concepts when compared to their non^program counterparts. Based on the 
ijiformation supplied by the prosram director concerning the amount of career 



147 



ERIC 



Table S 

Percent of Items Ansv;erGd CorrGctly by 



Curriculum GrpuplnQ o 





COGNITIVE ITEMS 


6 


Academic 


Academic 


Kdn-Acn< 


3emic 


Non— Academic 


R 


Pro 


gram 


Non'-Program 


Progri 


am 


Non^Program 


A 


Stu 


d cnt B 


Students 


Stv iants 


Students 


D 
E 




Post-- 


Pre- 


Post-^ 


Pre^ 


Post- 


Pre- 


Post- 




Test 


Test 


Test 


Tost 


Test 


Test 


Test 


Test 


10 


63 


67 


68 


71 


42 


58 


54 


58 



AFFECTIVE ITEMS 



G 
R 
A 


Academic 
Program 
- -- Rrndnnt!^ 


Aced emic 
Non-Progrnm 
Stud en to 


Kon-Academic 
Program 
Students 


Kon-Academic 
Kon-Program 
Students 


D 


















E 


Pre- 


Post- 


Pre- 


Post-^ 


Pre- 


Post- 


Pre- 


Post- 




Test 


Test 


Test 


Test 


Test 


' Test 


Test 


Test 


10 


71 


70 


75 


76 


50 


68 


70 


69 



148 



education received by non-program students, these results are very impres- 
sive* The program students from the Springfield Career Development Program 
began the year with a definite disadvantage when compared to the non-program 
students s and even though the non-program students were receiving some sort 
of career Sjif ormation, the program students were able to raise their scores 
and end the year with relatively little difference between program and non-- 
program learning. 

The post^test results for the affective test show that the attitudes 
of program and non-program academic students did not change considerably 
during the year. Each group received an overall score on the post-test 
that was approximately the same as the score they had received earlier on 
the pre-test* These results show that the program was not able to influ- 
ence the attitudes of its academic students to any extent. The scores for 
both academic program students and non-program students are relatively high 
and suggest that these students already have attitudes that are expected 
of career-educated students. As was the case with the cognitive tests the 
non-acadGraic program students began the year with a definite disadvantage 
when compared to their non-program counterparts* However ^ during the course 
of the year they were influenced by the program to the extent that on the 
May post-test they were able to display attitudes that were equal to their 
non^program counterparts. 

The success of the tenth grade program is most dramatically evidenced 
in the post--test results for non-academic students. Apparently ^ the pro- 
gram has been able to supply these students with the information and exper- 
iences necessary for showing ^creased cognitive and affective learning* 
These program efforts should be continued and future efforts might be direct'- 
ed towards changing the academic curriculum to give those students the same 
advantage as their non-academic counterparts. 
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CONCLUSIONS AND RECObQ^ffiNDATIONS 

Based on the results from the pre-test and post-test administered to 
the Springfield Career Development Program students * PSE offers these 
final conclusions and recormnendations . 

The program staff has been instrumental in changing teacher behavior 
and modifying curriculum content to the extent that 

• Program students in grades 3 and 6 were able to end the year showing 
slightly more knowledge of career education concepts and slightly 
better attitudes towards these concepts than their non-program 
matches. 

• Program students in grades^ 8 and 10 were able to show an increase 
in cognitive and affective learning between the pre=test and the 
post=tcst, 

• Program students in grades 3 and 6 were able to display slightly 
more knowledge and slightly better attitudes towards the concepto 
relating to all seven developmental areas than their non-program 
matches on the Hay post-test* 

• Progrnm students in grade 10 were able to decrease the margin of 
difference between program and non-program students' scores in 
all seven of the developmental areas on both the cognitive and 
affective sections of the Hay post=test. 

• Both program boys and program girls appear to be benefitting from 
the program efforts* 

• Both demographic groups are receiving instruction that- influences 
their cognitive and affective learning and gives them a slight 
advantage over their non-program counterparts. 
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Therefore* PSE would conclude that the program has made an Impact on 
ite students at all grade levela. Each grade level has its own strength 
and weaknesses and fulure program efforts can be directed accordingly. 
The results of these analyses reflect much of what we have observed while 
we were in the Springfield district* The weakest coinponent appaars to be 
the Orientation component and deserves further attention* The difference 
between program pre=test and post^test scores, especially on the cognitive 
teats indicates that the program has accomplished a great deal during the 
X975^75 school year. PSE very seldom finds pre-test and post^test scores 
that are so different. 



